Method and apparatus for improving and monitoring sleep

ABSTRACT

A method performed by an apparatus for inducing a sound sleep to induce a sound sleep of an object who is sleeping includes: determining a first wake-up time of the object based on schedule information of the object; receiving bio-information of the object; determining a sleep state of the object from the bio-information of the object; changing the first wake-up time to a second wake-up time by taking into account the sleep state of the object; and outputting a wake-up alarm signal at the second wake-up time.

CROSS-REFERENCE TO RELATED APPLICATION

This application is a continuation of U.S. patent application Ser. No.15/007,375, filed on Jan. 27, 2016, which claims the benefit of KoreanPatent Application No. 10-2015-0013902, respectively filed on Jan. 28,2015 in the Korean Intellectual Property Office, and Korean PatentApplication No. 10-2015-0028588 filed on Feb. 27, 2015, in the KoreanIntellectual Property Office, the disclosures of which are incorporatedby reference herein in their entireties.

BACKGROUND 1. Field

Aspects of one or more exemplary embodiments relate to a method andapparatus for improving and monitoring sleep of an object.

2. Description of the Related Art

Materials that are harmful to humans are present in the air and diseasescaused by physical and psychological stress are increasingly common.Also, electromagnetic waves released from various electronic devicesgreatly threaten human health. Accordingly, home appliances designedtaking into account users' health, such as washing machines usingnegative ions, rather than home appliances having improved functions,have been produced.

SUMMARY

Aspects of one or more exemplary embodiments include a method andapparatus for adaptively adjusting a wake-up time based on sleep stateinformation of an object who is sleeping.

Aspects of one or more exemplary embodiments include a method andapparatus for determining an emergency based on bio-information of anobject who is sleeping and selectively transmitting alarm informationrelated to the bio-information of the object to at least one of anear-field connection device and a far-field connection device.

Additional aspects will be set forth in part in the description whichfollows and, in part, will be apparent from the description, or may belearned by practice of the presented exemplary embodiments.

According to an aspect of one or more exemplary embodiments, there isprovided a method performed by an apparatus configured to improve asleep of an object who is sleeping, the method including: determining afirst wake-up time of the object based on schedule informationcorresponding to a schedule of the object; receiving bio-information ofthe object; determining a sleep state of the object from thebio-information; changing the first wake-up time to a second wake-uptime based on the sleep state of the object; and outputting a wake-upalarm signal at the second wake-up time.

The schedule information of the object may include at least one ofaverage wake-up time information, wake-up time information before goingto sleep, bedtime information, schedule information before going tosleep, blood alcohol level information before going to sleep, and firstschedule information after waking up.

The determining of the sleep state of the object may include determiningthe sleep state of the object based on at least one of heart rateinformation, respiration information, movement information, snoringpattern information, eyeball movement information, and body temperatureinformation of the object.

The first wake-up time and the second wake-up time may be earlier than apreset critical time.

The method may further include: measuring an actual wake-up time of theobject; determining a remaining time from the actual wake-up time of theobject to a preset critical time; selecting at least one activity thatis to be performed by the object during the remaining time; andproviding information about the selected at least one activity to theobject.

The providing of the information about the selected at least oneactivity may include displaying the information about the selected atleast one activity on an external display device.

The determining of the sleep state of the object may include: receivinginfrared image information of the object from an external device; andobtaining heart rate information of the object based on the receivedinfrared image information.

The determining of the sleep state of the object may include obtainingat least one of respiration rate information, respiration cycleinformation, and respiration volume information by using depth valueinformation that is obtained using a depth camera.

The method may further include: detecting that the object wakes up; andproviding information about an event that occurs within a preset timeafter the object wakes up.

The method may further include: detecting that the object is sleepingwithin a preset time after the second wake-up time; and transmittinginformation indicating that the object is sleeping to a device of adesignated third party.

The outputting of the wake-up alarm signal may include: outputting afirst wake-up alarm signal through a first device at the second wake-uptime; detecting that the object is sleeping within a preset time afterthe second wake-up time; and outputting a second wake-up alarm signalthrough a second device, the second device being different from thefirst device.

According to an aspect of one or more exemplary embodiments, there isprovided an apparatus configured to improve a sleep of an object who issleeping, the apparatus including: a communicator configured to receivebio-information of the object that is measured by a sensor; a controllerconfigured to determine a sleep state of the object based on thebio-information, determine a first wake-up time of the object based onschedule information corresponding to a schedule of the object, andchange the first wake-up time to a second wake-up time based on thesleep state of the object; and an output device configured to output awake-up alarm signal at the second wake-up time.

The apparatus may further include the sensor configured to obtain thebio-information of the object.

The communicator may be further configured to receive infrared imageinformation of the object from an external display device, and thecontroller may be further configured to obtain heart rate information ofthe object based on the received infrared image information, anddetermine the sleep state of the object based on the heart rateinformation.

The controller may be further configured to obtain at least one ofrespiration rate information, respiration cycle information andrespiration volume information of the object by using depth valueinformation that is obtained using a depth camera.

The controller may be further configured to detect that the object issleeping within a preset time after the second wake-up time, and thecommunicator may be further configured to transmit informationindicating that the object is sleeping to a device of a designated thirdparty.

The output device may include a first device and a second device, thesecond device being different from the first device, and the controllermay be further configured to output a first wake-up alarm signal throughthe first device at the second wake-up time, and, in response to itbeing detected that the object is sleeping within a preset time afterthe second wake-up time, output a second wake-up alarm signal throughthe second device.

According to an aspect of one or more exemplary embodiments, there isprovided an alarm method of an apparatus configured to improve sleep ofan object who is sleeping, the alarm method including: detecting analarm event; measuring a sleep depth of the object; determining an alarmcondition corresponding to the sleep depth; and outputting an alarmsignal related to the alarm event based on the determined alarmcondition.

The detecting the alarm event may include receiving an alarm messagefrom an external device using near-field communication.

The determining the alarm condition corresponding to the sleep depth mayinclude adjusting an output cycle of the alarm signal according to thesleep depth.

The determining the alarm condition corresponding to the sleep depth mayinclude: determining an output time of the alarm signal based on thesleep depth; and outputting the alarm signal at the determined outputtime.

The determining the alarm condition corresponding to the sleep depth mayinclude adjusting an output intensity of the alarm signal based on thesleep depth.

The determining the alarm condition may include determining the alarmcondition corresponding to the sleep depth based on an urgency of thealarm event.

The outputting the alarm signal may include outputting the alarm signalas at least one of a vibration signal, an audio signal, and a videosignal.

According to an aspect of one or more exemplary embodiments, there isprovided an apparatus configured to improve sleep of an object, theapparatus including: a communicator configured to receive informationabout an alarm event and bio-information of the object that is measuredby a sensor; a controller configured to determine a sleep depth of theobject based on the bio-information, and determine an alarm conditioncorresponding to the sleep depth; and an output device configured tooutput an alarm signal related to the alarm event based on thedetermined alarm condition.

The apparatus may further include the sensor configured to obtain thebio-information of the object.

The controller may be further configured to adjust an output cycle ofthe alarm signal according to the sleep depth.

The controller may be further configured to determine an output time ofthe alarm signal based on the sleep depth, and control the output deviceto output the alarm signal at the determined output time.

The controller may be further configured to adjust an output intensityof the alarm signal based on the sleep depth.

According to an aspect of one or more exemplary embodiments, there isprovided a method performed by an apparatus configured to controlambient noise, the method including: recognizing that an object issleeping; detecting a noise signal within a predetermined distance fromthe object through an audio input device; determining a noise patternhaving periodic characteristics by analyzing the noise signal; andoutputting an anti-phase noise pattern having a phase that is oppositeto a phase of the noise pattern through an audio output device.

The outputting of the anti-phase noise pattern may include: measuring asleep depth of the object; and determining whether to output theanti-phase noise pattern based on the sleep depth of the object.

The determining whether to output the anti-phase noise pattern mayinclude: determining to not output the anti-phase noise pattern andinactivating the audio output device in response to the sleep depth ofthe object being determined to be greater than a critical value; anddetermining to output the anti-phase noise pattern and activating theaudio output device in response to the sleep depth of the object beingdetermined to be less than or equal to the critical value.

The determining whether to output the anti-phase noise pattern mayinclude adjusting an output intensity of the anti-phase noise patternbased on the sleep depth of the object.

The outputting of the anti-phase noise pattern may include synchronizinga first cycle in which the noise pattern repeats in the noise signalwith a second cycle in which the anti-phase noise pattern is output.

The outputting of the anti-phase noise pattern may include outputtingthe anti-phase noise pattern through a plurality of the audio outputdevices.

Each of the audio input device and the audio output device may belocated within a preset distance from the object.

The determining of the noise pattern having the periodic characteristicsmay include: receiving, from an external device, cycle information ofthe noise signal that is generated in the external device; anddetermining the noise pattern by using the received cycle information.

The determining of the noise pattern by analyzing the noise signal mayinclude selecting a first noise pattern that is generated in adesignated external device from among a plurality of noise patterns.

According to an aspect of one or more exemplary embodiments, there isprovided an apparatus configured to control ambient noise, the apparatusincluding: a communicator configured to receive bio-information of anobject that is measured from a sensor; an audio input device configuredto detect a noise signal; a controller configured to determine a sleepstate of the object based on the bio-information, and determine a noisepattern having periodic characteristics by analyzing the noise signal;and an audio output device configured to output an anti-phase noisepattern having a phase that is opposite to a phase of the noise pattern.

The apparatus may further include the sensor configured to obtain thebio-information of the object.

The audio input device may be further configured to detect the noisesignal within a predetermined distance from the object.

The apparatus may further include a plurality of audio output devicesthat each output the anti-phase noise pattern.

According to an aspect of one or more exemplary embodiments, there isprovided a non-transitory computer-readable recording medium havingembodied thereon a program for executing one or more of the abovemethods.

According to an aspect of one or more exemplary embodiments, there isprovided a method performed by an apparatus configured to monitor apatient, the method including: receiving bio-information of the patient;transmitting the bio-information to an external device; and controllingan environmental device based on the bio-information to adjust anenvironment around the patient.

The bio-information may include at least one from among anelectroencephalogram (EEG), an electrocardiogram (ECG), a heart rate, anoxygen saturation, a blood pressure, a movement, and a blood sugarlevel, a respiration movement, a body temperature, a sleep depth, and asleep pattern of the patient.

The environmental device may include at least one from among an airconditioner, an air cleaner, a heater, a lighting device, a humidifier,a ventilator, a window controller, and a curtain controller.

According to an aspect of one or more exemplary embodiments, there isprovided a power-saving method of an apparatus, the power-saving methodincluding: determining that an object is in a sleep state; andtransmitting, in response to determining that the object is in the sleepstate, a power saving mode request to a first external device of one ormore external devices, wherein, in response to the power saving moderequest, at least one of a power supply is cut off from a secondexternal device of the one or more external devices and the secondexternal device enters a standby mode.

The power-saving method may further include: determining that the objectwakes up from the sleep state; and transmitting, in response todetermining that the object wakes up from the sleep state, a powersaving mode cancellation request to the first external device, wherein,in response to the power saving mode cancellation request, at least oneof the power is resupplied to the second external device and the secondexternal device enters an active mode.

BRIEF DESCRIPTION OF THE DRAWINGS

These and/or other aspects will become apparent and more readilyappreciated from the following description of one or more exemplaryembodiments, taken in conjunction with the accompanying drawings inwhich:

FIG. 1 is a view illustrating a system for monitoring an apnea state ofan object, according to an exemplary embodiment;

FIG. 2 is a view illustrating a system for monitoring for cardiac arrestof the object, according to an exemplary embodiment;

FIG. 3A is a block diagram of an apparatus for inducing a sound sleep,according to an exemplary embodiment;

FIG. 3B is a view illustrating an outer appearance of the apparatus,according to an exemplary embodiment;

FIG. 4 is a block diagram of a sensor of the apparatus, according to anexemplary embodiment;

FIG. 5 is a view illustrating a system for monitoring the object in ahospital, according to an exemplary embodiment;

FIG. 6 is a view illustrating a system used by a display device tomonitor the object, according to an exemplary embodiment;

FIG. 7 is a flowchart illustrating a method performed by the displaydevice to determine a heart rate/respiration rate, according to anexemplary embodiment;

FIG. 8 is a view illustrating a method performed by the display deviceto determine a heart rate/respiration rate, according to an exemplaryembodiment;

FIG. 9 is a flowchart illustrating a method performed by the apparatusto adjust a wake-up time, according to an exemplary embodiment;

FIG. 10 is a flowchart illustrating a method performed by the apparatusto control a peripheral device according to a sleep state of the object,according to an exemplary embodiment;

FIG. 11 is a flowchart illustrating a method of monitoring the objectwho is sleeping, according to an exemplary embodiment;

FIG. 12 is a timing diagram illustrating a method performed by theapparatus to communicate with at least one of a near-field connectiondevice and a far-field connection device, according to an exemplaryembodiment;

FIG. 13 is a flowchart illustrating a method of adjusting a curtain or ablind according to a brightness of light, according to an exemplaryembodiment;

FIG. 14 illustrates a method performed by the apparatus to control acurtain according to a brightness of light in a bedroom, according to anexemplary embodiment;

FIG. 15 is a flowchart illustrating a method of removing noise aroundthe object by using an audio output device, according to an exemplaryembodiment;

FIG. 16 is a graph illustrating a triggered spectral subtraction methodusing periodic characteristics of a noise pattern, according to anexemplary embodiment;

FIGS. 17 and 18 are views illustrating an example where the apparatusremoves noise around the object by using an audio output device,according to an exemplary embodiment;

FIG. 19 is a view illustrating an example where the apparatus uses aplurality of audio output devices, according to an exemplary embodiment;

FIG. 20 is a flowchart illustrating a method of removing noise accordingto a sleep depth of the object, according to an exemplary embodiment;

FIG. 21 is a graph illustrating an example where the apparatusdetermines whether to activate an audio output device according to asleep depth of the object, according to an exemplary embodiment;

FIG. 22 is a flowchart illustrating a method of adjusting an alarmcondition according to a sleep depth of the object, according to anexemplary embodiment;

FIG. 23 is a view illustrating an example where an intensity of an alarmsignal is adjusted according to a sleep depth of the object, accordingto an exemplary embodiment;

FIGS. 24 and 25 are views illustrating an example where an alarm signalcycle is adjusted according to a sleep depth of the object and anurgency of an alarm event, according to an exemplary embodiment;

FIG. 26 is a flowchart illustrating a method of transmitting to theoutside a message indicating that the object is sleeping, according toan exemplary embodiment;

FIG. 27 is a view illustrating an example where the apparatus transmitsa message indicating that a first object is sleeping to a device of asecond object, according to an exemplary embodiment;

FIG. 28 is a view illustrating an example where the apparatus outputs apreset message through an intercom device, according to an exemplaryembodiment;

FIG. 29 is a flowchart illustrating a method performed by the apparatusto transmit going-back-to-sleep information of a first object to adevice of a second object, according to an exemplary embodiment;

FIG. 30 is a view illustrating an example where the apparatus transmitsgoing-back-to-sleep information of a first object to a device of asecond object, according to an exemplary embodiment;

FIG. 31 is a flowchart illustrating a method performed by the apparatusto output a wake-up alarm signal by sequentially using a plurality ofdevices, according to an exemplary embodiment;

FIG. 32 is a view illustrating an example where, when the object wentback to sleep, the apparatus outputs a wake-up alarm signal through adisplay device as well as an alarm clock, according to an exemplaryembodiment;

FIG. 33 is a timing diagram illustrating a method of displaying scheduleinformation through a display device when the object wakes up, accordingto an exemplary embodiment;

FIG. 34 is a view illustrating an example where, when the object wakesup, schedule information is displayed on the display device, accordingto an exemplary embodiment;

FIG. 35 is a timing diagram illustrating a method of changing anoperation mode of a peripheral device to a power saving mode when theobject is sleeping, according to an exemplary embodiment;

FIG. 36 is a view illustrating an example where, when a plurality ofobjects are sleeping, an operation mode of a peripheral device ischanged to a power saving mode, according to an exemplary embodiment;

FIG. 37 is a timing diagram illustrating a method of cancelling a powersaving mode of a peripheral device (or requesting for an operation of apredetermined device) when the object wakes up, according to anexemplary embodiment; and

FIG. 38 is a view illustrating an example where, when the object wakesup, a predetermined device automatically operates, according to anexemplary embodiment.

DETAILED DESCRIPTION

Reference will now be made in detail to one or more exemplaryembodiments, examples of which are illustrated in the accompanyingdrawings.

Most of the terms used herein are general terms that have been widelyused in the technical art to which one or more exemplary embodimentspertain. However, some of the terms used herein may be createdreflecting intentions of technicians in this art, precedents, or newtechnologies. Also, some of the terms used herein may be arbitrarilychosen by the present applicant. In this case, these terms are definedin detail below. Accordingly, the specific terms used herein should beunderstood based on the unique meanings thereof and the whole context ofthe inventive concept.

As used herein, the singular forms “a”, “an” and “the” are intended toinclude the plural forms as well, unless the context clearly indicatesotherwise. It will be further understood that the terms “includes,”“including,” “comprises,” and “comprising” used herein specify thepresence of stated features, integers, steps, operations, members,components, and/or groups thereof, but do not preclude the presence oraddition of one or more other features, integers, steps, operations,members, components, and/or groups thereof.

Throughout the specification, it will be understood that when an elementis referred to as being “connected” to another element, it may be“directly connected” to the other element or “electrically connected” tothe other element with intervening elements therebetween. Also, when anelement is referred to as being “connected” to another element, it maycommunicate with the other element by transmitting/receiving a signal.It will be further understood that when a part “includes” or “comprises”an element, unless otherwise defined, the part may further include otherelements.

As used herein, the term “and/or” includes any and all combinations ofone or more of the associated listed items. Expressions such as “atleast one of” when preceding a list of elements, modify the entire listof elements and do not modify the individual elements of the list.

FIG. 1 is a view illustrating a system for monitoring an apnea state ofan object 10, according to an exemplary embodiment.

An apparatus 100 for inducing a sound sleep may obtain bio-informationrelated to a state of the object 10, that is, a user. The object 10 maybe, as non-limiting examples, a person, a patient, or an animal who issleeping. The bio-information may include information of the object 10that may be obtained by using a sensor that is included in the apparatus100. As non-limiting examples, the bio-information may include, asnon-limiting examples, at least one of an electroencephalogram (EEG), anelectrocardiogram (ECG), a heart rate, an oxygen saturation level, ablood pressure, a movement, and a blood sugar level of the object 10.The apparatus 100 may obtain the bio-information not only from thesensor that is included in the apparatus 100 but also from otherdevices. For example, the apparatus 100 may receive infrared imageinformation of the object 10 that is obtained through a camera 232 thatis provided in a display device 230 separate from the apparatus 100. Thedisplay device 230 may be a device that displays content, such as a TVor a monitor. The camera 232 may be an infrared camera. The apparatus100 may obtain heart rate information or respiration information (e.g.,respiration rate information, respiration cycle information, orrespiration volume information) of the object 10 based on the receivedinfrared image information, as non-limiting examples. The display device230 may determine the heart rate information or the respirationinformation based on the infrared image information from the displaydevice 230 and transfer the heart rate information or the respirationinformation to the apparatus 100.

Alternatively, the camera 232 may be a depth camera. The apparatus 100may obtain, as non-limiting examples, at least one of respiration rateinformation, respiration cycle information, respiration volumeinformation, and heart rate information of the object 10 based on depthvalue information that is obtained through the depth camera. An image ofthe object 10 that is captured by the camera 232 may be an image of aspecific region of the object 10. For example, the camera 232 may obtaininformation about an image of the chest of the object 10.

The apparatus 100 may transmit information to another device accordingto the obtained bio-information. The information that is transmitted tothe other device may include an alarm signal related to the obtainedbio-information. The apparatus 100 may compare the obtainedbio-information with reference bio-information and may transmitinformation to the other device according to a result of the comparison.

According to an exemplary embodiment, the alarm signal may include acontrol signal for controlling a function of the other device. When itis determined according to the obtained bio-information that the object10, who is sleeping, is in an apnea state, the apparatus 100 may selecta specific device for improving the apnea state of the object 10. Theapparatus 100 may transmit a control signal to the selected specificdevice. For example, the apparatus 100 may transmit an air cleaningrequest signal to an air cleaner 260.

According to an exemplary embodiment, the apparatus 100 may be connectedto an Internet of things (IoT) hub 200 in order to transmit informationto the other device. The apparatus 100 may transmit the alarm signal tothe specific device through the IoT hub 200. The IoT hub 200 may be agateway or a server for connecting IoT devices.

Also, the term ‘IoT device’ used herein may refer to a device thatcollects data through a sensor and shares the collected data with otherIoT devices through a network interface. Examples of the IoT device mayinclude, but are not limited to, a smartphone, a wearable terminal(e.g., a wearable glass, a ring, a necklace, a wristband, a wristwatch,a shoe, an earring, a hair band, a garment, a glove, or a thimble), adoor locking device, a sensor system, a smart bulb, a refrigerator, awashing machine, an air conditioner, an audio system, a TV, a robotcleaner, a humidifier, a smart fork, a ventilator, a window controller,an air cleaner, a kitchen gadget, a bicycle, an exercise machine, and atoilet kit.

According to an exemplary embodiment, the apparatus 100 may determine adevice to which the alarm signal (e.g., a signal indicating that theobject 10 is in an apnea state) is to be transmitted according to aperiod of time for which the apnea state lasts. For example, when theperiod of time for which the apnea state lasts is greater than a firstcritical value, the apparatus 100 may transmit a first alarm signal to anear-field connection device using near-field wireless communication inorder to correct the apnea state. For example, the apparatus 100 maytransmit the alarm signal to a portable terminal 210 or a wearableterminal 220 that is located in a near-field communication zone.Examples of the portable terminal 210 may include, but are not limitedto, a smartphone, a personal digital assistant (PDA), a cellular phone,a navigation system, and a digital multimedia broadcasting (DMB)terminal. Also, the wearable terminal 220 refers to a body-borneterminal such as a smart watch, a head-mounted display (HMD), or awearable computer, but is not limited thereto. The portable terminal 210or the wearable terminal 220 that receives the alarm signal may displaya message 212 indicating that the object 10 is in the apnea state or mayoutput a vibration signal or an alarm sound. In this case, a user whouses the portable terminal 210 or the wearable terminal 220 mayrecognize a state of the object 10 based on the message 212 indicatingthat the object 10 is in the apnea state.

According to another exemplary embodiment, the apparatus 100 maytransmit the alarm signal to an audio output device 240 and may causethe audio output device 240 to output a sound signal 242 indicating thatthe object 10 is in the apnea state. According to another exemplaryembodiment, the apparatus 100 may transmit the alarm signal to a devicethat is connected to a home network. For example, the apparatus 100 mayadjust a temperature in a room by using an air conditioner/heater 250,may change the air in the room by using the air cleaner 260, may open orclose a window by using a window controller 270, or may adjust anilluminance in the room by using a lighting device 280. Alternatively,the apparatus 100 may ventilate the room by using a ventilator 290.

When the period of time for which the apnea state of the object 10 lastsis greater than a second critical value, the apparatus 100 may transmita second alarm signal (e.g., a signal indicating that the apnea state ofthe object 10 lasts for a second critical time or more) about theobtained bio-information to a far-field connection device usingfar-field communication. The second critical value may be greater thanthe first critical value. That is, when the period of time for which theapnea state lasts exceeds the second critical value, the apparatus 100may determine that the object 10 is in a very bad state, and may notonly transmit the first alarm signal to the near-field connection devicebut also additionally transmit the second alarm signal to the far-fieldconnection device. For example, the apparatus 100 may transmit the alarmsignal to a portable terminal 310 (e.g., a cellular phone of adesignated doctor) or a wearable terminal 320 that is located in afar-field communication zone through a network 300, and thus may enablea user (e.g., the designated doctor) of the portable terminal 310 or thewearable terminal 320 to recognize the state of the object 10. Examplesof the portable terminal 310 may include, but are not limited to, asmartphone, a PDA, a cellular phone, a navigation system, and a DMBterminal. Also, the wearable terminal 320 refers to a body-borneterminal such as a smart watch, an HMD, or a wearable computer, but isnot limited thereto. The portable terminal 310 or the wearable terminal320 may be a terminal (referred to as a designated terminal of a doctor)of a designated doctor who is designated for the object 10.

According to another exemplary embodiment, the apparatus 100 maytransmit the alarm signal to an external server 330 of a medicalinstitute or an emergency care center through the network 300. Theexternal server 330 that receives the alarm signal may transmitinformation indicating that the object 10 is in an emergency through anemergency receiver 332 to the medical institute or the emergency carecenter. For example, the external server 330 that receives the alarmsignal may transmit information about a device for diagnosing the object10 or a drug for emergency treatment to the portable terminal 310 of arescue squad, e.g., an emergency medical technician. In this case, therescue squad may rapidly gather up the device for diagnosing the object10 or the drug before departure.

Also, the apparatus 100 may receive information related to the state ofthe object 10 in response to the alarm signal that is transmitted to theoutside. For example, the apparatus 100 may receive from the outsideinformation about an action to be taken by the object 10 who is in theapnea state and may output the received information on the displaydevice 230. Also, at least one of the apparatus 100, the display device230, the portable terminal 210, and the wearable terminal 220 mayreceive information about the device for diagnosing the object 10 or thedrug for emergency treatment from the external server 330. Accordingly,when the rescue squad has arrived, the rescue squad may receive theinformation about the device for diagnosing the object 10 or the drugfor emergency treatment.

The apparatus 100 may be a device that is included in a bed, as shown inFIG. 1, or is located under a mattress and may measure a respirationmovement, a pulse, a body temperature, and blood pressure of the object10, or may be a device that is separate from the bed. The apparatus 100may be included in the IoT hub 200. Alternatively, the apparatus 100 maybe included in the display device 230. However, one or more exemplaryembodiments are not limited thereto, and the apparatus 100 may be anyappropriate apparatus that may obtain information about the object 10.For convenience of description, the following will be explained on theassumption that the apparatus 100 is attached to the bed.

Also, according to another exemplary embodiment, the apparatus 100 mayset a wake-up time of the object 10 when the object 10 is sleeping. Theapparatus 100 may determine a first wake-up time of the object 10 basedon object information. The object information may include at least oneof average wake-up time information, wake-up time information beforegoing to sleep, bedtime information, schedule information before goingto sleep, blood alcohol level information before going to sleep, bodytemperature information before going to sleep, heart rate informationbefore going to sleep, and environment information (e.g., an atmospherictemperature or humidity) around the object 10. Next, the apparatus 100may obtain sleep state information of the object 10 who is sleepingbased on the obtained bio-information. Also, the apparatus 100 maychange the first wake-up time into a second wake-up time by taking intoaccount the sleep state information of the object 10. That is, theapparatus 100 may periodically or continuously update a set wake-up timeaccording to the sleep state information of the object 10 until acurrent time is the set wake-up time. For example, when the object 10 isin the apnea state for a short period of time, the apparatus 100 maydelay the wake-up time of the object 10. When a current time is the setwake-up time, the apparatus 100 may output a wake-up alarm signal.

FIG. 2 is a view illustrating a system for monitoring for cardiac arrestof the object 10, according to an exemplary embodiment.

The apparatus 100 may obtain bio-information related to a state of theobject 10, that is, a user. For example, the bio-information mayinclude, as non-limiting examples, at least one of an EEG, an ECG, aheart rate, an oxygen saturation level, a blood pressure, a movement,and a blood sugar level of the object 10. The apparatus 100 may obtainthe bio-information not only from a sensor that is included in theapparatus 100 but also from another device. For example, the apparatus100 may receive infrared image information of the object 10 that isobtained through the camera 232 that is provided in the display device230 that is disposed separate from the apparatus 100. The display device230 may be a device that displays content, such as a TV or a monitor,and the camera 232 may be, as a non-limiting example, an infraredcamera. The apparatus 100 may obtain, as non-limiting examples, heartrate information or respiration information (e.g., respiration rateinformation, respiration cycle information, or respiration volumeinformation) of the object 10 based on the received infrared imageinformation. For example, the apparatus 100 may receive from the displaydevice 230 the heart rate information or the respiration information ofthe object 10 that is obtained by the display device 230 based on theinfrared image information.

Alternatively, the camera 232 may be a depth camera. The apparatus 100may obtain, as non-limiting examples, at least one of respiration rateinformation, respiration cycle information, respiration volumeinformation, and heart rate information of the object 10 based on depthvalue information that is obtained through the depth camera. An image ofthe object 10 that is captured by the camera 232 may be an image of aspecific region of the object 10. For example, the camera 232 may obtaininformation about an image of the chest of the object 10.

The apparatus 100 may obtain information about a state related to aheartbeat of the object 10 based on the bio-information. The apparatus100 may transmit information to another device according to the staterelated to the heartbeat that is determined according to thebio-information. The information that is transmitted to the other devicemay include an alarm signal related to the obtained bio-information.

The alarm signal may include a control signal for controlling a functionof the other device. When it is determined based on the obtainedbio-information that the object 10 shows a presymptom related to cardiacarrest, the apparatus 100 may select a specific device for preventingthe object 10 from suffering from cardiac arrest. The apparatus 100 maytransmit the control signal to the selected specific device. Forexample, when a heart rate of the object 10 that is included in thebio-information indicates that a pulse of the object 10 is irregular,the apparatus 100 may control a device around the apparatus 100 in orderto correct the irregular pulse of the object 10. The apparatus 100 maytransmit the alarm signal to the specific device through the IoT hub200. The apparatus 100 may transmit a first alarm signal to a near-fieldconnection device using near-field wireless communication in order toprevent the object 10 from suffering from cardiac arrest. For example,the apparatus 100 may transmit the alarm signal to the portable terminal210 or the wearable terminal 220. Examples of the portable terminal 210may include, but are not limited to, a smartphone, a PDA, a cellularphone, a navigation system, and a DMB terminal. The wearable terminal220 may refer to, as non-limiting examples, a body-borne terminal suchas a smart watch, an HMD, or a wearable computer. The portable terminal210 or the wearable terminal 220 that receives the alarm signal maydisplay a message 214 indicating that the object 10 is likely to sufferfrom cardiac arrest or may output a vibration signal or an alarm sound.In this case, a user of the portable terminal 210 or the wearableterminal 220 may recognize a state of the object 10 based on the message214 indicating that the object 10 is likely to suffer from cardiacarrest. Also, the portable terminal 210 or the wearable terminal 220that receives the alarm signal may display information about measuresfor preventing the object 10 from suffering from cardiac arrest. Theinformation about the measures for preventing the object 10 fromsuffering from cardiac arrest may be stored in the portable terminal 210or the wearable terminal 220, or may be obtained from an external devicethrough a search or an additional request.

According to another exemplary embodiment, the apparatus 100 maytransmit the alarm signal to the audio output device 240. In this case,the audio output device 240 may generate an alarm sound 244 (e.g., asound indicating that the object 10 is likely to suffer from cardiacarrest), and thus may notify the object 10 or a third person of thestate of the object 10. According to another exemplary embodiment, theapparatus 100 may transmit the alarm signal to a device that isconnected to a home network. For example, the apparatus 100 may adjust atemperature in a room by using the air conditioner/heater 250, maychange the air in the room by using the air cleaner 260, may open orclose a window by using the window controller 270, may adjust anilluminance in the room by using the lighting device 280, or mayventilate the room by using the ventilator 290.

Also, when it is determined that the object 10 goes into cardiac arrest,the apparatus 100 may transmit a second alarm signal (e.g., informationindicating that the object 10 has gone into cardiac arrest) to afar-field connection device using far-field communication. That is, whenthe object 10 goes into cardiac arrest and thus is in an emergency, theapparatus 100 may notify not only the device around the apparatus 100but also a far-field connection device that the object 10 is in anemergency. For example, the apparatus 100 may transmit the alarm signalto the portable terminal 310 or the wearable terminal 320 that islocated in a far-field communication zone through the network 300, andthus may enable a user (e.g., a doctor in charge) of the portableterminal 310 or the wearable terminal 320 to recognize the state of theobject 10. Examples of the portable terminal 310 may include, but arenot limited to, a smartphone, a PDA, a cellular phone, a navigationsystem, and a DMB terminal. Also, the wearable terminal 320 may referto, as non-limiting example, a body-borne terminal such as a smartwatch, an HMD, or a wearable computer. The portable terminal 310 or thewearable terminal 320 may be a designated terminal of a doctordesignated for the object 10.

According to another exemplary embodiment, the apparatus 100 maytransmit the alarm signal to the external server 330 of a medicalinstitute or an emergency care center through the network 300. Theexternal server 330 that receives the alarm signal may notify themedical institute or the emergency care center that the object 10 is inan emergency through the emergency receiver 332. For example, theexternal server 330 that receives the alarm signal may transmitinformation about a device for diagnosing the object 10 or a drug foremergency treatment to the portable terminal 310 of a rescue squad. Inthis case, the rescue squad may rapidly gather up the device or the drugbefore departure.

Also, the apparatus 100 may receive information related to the state ofthe object 10 in response to the alarm signal that is transmitted to anexternal device. For example, the apparatus 100 may receive informationabout an action to be taken by the object 10 who goes into cardiacarrest state, and may output the received information on the displaydevice 230. Also, at least one of the apparatus 100, the display device230, the portable terminal 210, and the wearable terminal 220 mayreceive information about the device for diagnosing the object 10 or thedrug for emergency treatment from the external server 330 that receivesthe alarm signal. Accordingly, when the rescue squad has arrived, therescue squad may receive the information about the device for diagnosingthe object 10 or the drug for emergency treatment.

The apparatus 100 may be a device that is included in a bed, as shown inFIG. 2, or is located under a mattress and may measure a respirationmovement, a pulse, a body temperature, and a blood pressure of theobject 10, or may be a device that is separate from the bed. Theapparatus 100 may be included in the IoT hub 200. The apparatus 100 maybe included in the display device 230. However, one or more exemplaryembodiments are not limited thereto, and the apparatus 100 may be anyappropriate device capable of obtaining information about the object 10.

FIG. 3A is a block diagram of the apparatus 100 according to anexemplary embodiment. The apparatus 100 may include a terminal interface(I/F) 101, a user authenticator 102, e.g., a user authenticating unit, acontroller 103, e.g., a processor, a power supply 104, e.g., a powersupply unit, a sensor 105, a user interface (I/F) 106, a communicator107, e.g., a transceiver, a storage 108, e.g., a memory or a storageunit, an environment adjuster 109, e.g., an environment adjusting unit,a mechanism adjuster 110, e.g., a mechanism adjusting unit, and anoutput device 111, e.g., an audio/video (A/V) unit or an outputter. Theapparatus 100 of FIG. 3A is a device for monitoring a sleep state of theobject 10 and may be applied to another similar device. Examples of theother similar device may include, as non-limiting examples, a TV, aset-top box, a refrigerator, a washing machine, a PC, a laptop computer,a tablet computer, and a smartphone.

The terminal interface 101 may detect another device that may beconnected to the apparatus 100. For example, the terminal interface 101may detect the portable terminal 210, the wearable terminal 220, thedisplay device 230, the audio output device 240, e.g., a speaker, theair conditioner/heater 250, the air cleaner 260, the window controller270, the lighting device 280, the ventilator 290, the portable terminal310, the wearable terminal 320, and the external server 330.Representative examples of the portable terminals 210 and 310 mayinclude a cellular phone, a PDA, an MPEG audio layer 3 (MP3) player, alaptop computer, and a palm-top computer. Representative examples of thewearable terminals 220 and 320 may include a smart watch, an HMD, and awearable computer.

The user authenticator 102 determines whether a user of the apparatus100 has a right to use the apparatus 100. The apparatus 100 according toan exemplary embodiment may be installed in a private house or may beinstalled in a public accommodation such as a hospital. The userauthenticator 102 for preventing the apparatus 100 installed in a publicaccommodation allows only users who have a right to use the apparatus100 to use the apparatus 100. For example, only the user who pays a feefor the apparatus 100 and gets the right to use the apparatus 100 mayuse the apparatus 100. However, when the apparatus 100 is installed in aprivate house, the user authenticator 102 may be omitted.

The user authenticator 102 may authenticate a user by using the portableterminal 210 or the wearable terminal 220 of the object 10. The userauthenticator 102 may authenticate the user through voice recognition,fingerprint recognition, or iris recognition. An authentication methodmay vary according to one or more exemplary embodiments.

When bio-information of the object 10 is not obtained (for example, theportable terminal 210 or the wearable terminal 220 of the object 10 isnot located in a near-field communication zone) or when the userauthenticator 102 determines that the object 10 has no right to use theapparatus 100, the controller 103 maintains a stand-by mode in which thepower supply 104 supplies power only to the terminal interface 101, theuser interface 106, and the controller 103. When it is determined thatthe portable terminal 210 or the wearable terminal 220 is connected in awired manner or may be connected using near-field wireless communicationvia the terminal interface 101, the controller 103 controls a poweradjusting function of the power supply 104 to change a power state ofthe apparatus 100 from the stand-by mode to an active mode in whichpower is supplied to all of the elements in addition to the terminalinterface 101, the user authenticator 102, and the controller 103.However, when the apparatus 100 is included or installed in a piece offurniture such as a bed or a sofa, the controller 103 may control thepower supply 104 to change from the stand-by mode to the active modeaccording to a seating state of the user, that is, a pressed state ofthe piece of furniture, instead of whether the portable terminal 210 orthe wearable terminal 220 is detected. However, one or more exemplaryembodiments are not limited thereto, and a method performed by thecontroller 103 to control power may vary according to various exemplaryembodiments.

When the apparatus 100 is installed in a public accommodation, thecontroller 103 may control the power adjusting function of the powersupply 104 to change from the stand-by mode to the active mode only whenthe user authenticator 102 determines that the user of the apparatus 100has the right to use the apparatus 100. When it is determined that thereis no object 10 in the active mode, the controller 103 may control thepower adjusting function of the power supply 104 to change from theactive mode to the stand-by mode. That is, when the portable terminal210 or the wearable terminal 220 of the user is connected to theterminal interface 101 by being inserted into a connector that isattached to the terminal interface 101 or using near-field wirelesscommunication, the apparatus 100 may enter the active mode in which allfunctions are performed. However, when the connection between theterminal interface 101 and the portable terminal 210 or the wearableterminal 220 of the user is turned off, the apparatus 100 may enter thestand-by mode in which only a function of detecting the connectionbetween the terminal interface 101 and the portable terminal 210 or thewearable terminal 220 is performed.

Also, the controller 103 may control a communication function of thecommunicator 107 to download personal information of the object 10 fromthe portable terminal 210 or the wearable terminal 220 of the object 10,to connect the apparatus 100 to a server 130 that is located at a remoteplace through a network 120, or to transmit an alarm signal to theportable terminal 30 or the wearable terminal 320 of a rescue squad (forexample, a 911 rescue squad) or a doctor in charge through a publicswitched telephone network (PSTN). The server 130 may include, asnon-limiting examples, at least one of a cloud server, a personalizedserver, a medical institute server, and a health information storageserver (e.g., an electronic medical record (EMR) server, an electronichealth record (EHR) server, or a personal health record (PHR) server).The server 130 may include an intelligence engine, and may analyze sleepstate information of the object 10 that is obtained by the apparatus 100through the intelligence engine and may transmit information forcontrolling a peripheral device to the apparatus 100. For example, theserver 130 may transmit to the apparatus 100 information for controllinga hygrometer to measure humidity at 1-hour intervals when the object 10is sleeping and to measure humidity at 2-hour intervals when the object10 is awake.

Also, the controller 103 may control a sensing function of the sensor105 to sense an environment around the apparatus 100 or to measure thebio-information of the object 10. The controller 103 may control atleast one function provided by the apparatus 100 based on at least oneof the personal information that is downloaded and remote controlinformation that is received through the communicator 107, theinformation about the environment and the bio-information that areobtained by the sensor 105, and direct control information that is inputto the user interface 106. According to an exemplary embodiment,functions provided by the apparatus 100 may include an environmentadjusting function of the environment adjuster 109, a mechanismoperation adjusting function of the mechanism adjuster 110, an A/Vcontent output adjusting function of the output device 111, a noisereducing function of the output device 111, a power adjusting functionof the power supply 104, the communication function of the communicator107, and the sensing function of the sensor 105.

Examples of the personal information of the object 10 may include bodystate information of the object 10, identification information of theobject 10, health care history information of the object 10, andpreferred A/V content information of the object 10. Examples of the bodystate information of the object 10 may include the bio-informationmeasured by the portable terminal 210, the wearable terminal 220, or thecamera 232, and the bio-information measured by a measurement device ofthe apparatus 100. That is, the controller 103 may control a wake-uptime managing function, an alarm signal transmitting function, and anenvironment adjusting function provided by the apparatus 100 accordingto a body state of the object 10 indicated by the personal informationthat is downloaded through the communicator 107. When thebio-information indicates an emergency such as an apnea state for a longperiod of time, a heart attack, or cardiac arrest state, the controller103 may control the communication function of the communicator 107 totransmit an alarm signal indicating a state of the object 10 to afar-field connection device.

Examples of the bio-information of the object 10 may include an ECG, anoxygen saturation level (SpO₂), an EEG, a blood pressure, a pulse, arespiration movement, and a body temperature of the object 10. Thesensor 105 may include various sensors in order to obtain thebio-information of the object 10. Alternatively, the apparatus 100 mayreceive, from another device, the bio-information that is obtained bythe other device. For example, the apparatus 100 may receive imageinformation about the object 10 that is obtained through the camera 232,or may receive the bio-information that is detected through the portableterminal 210 or the wearable terminal 220.

Examples of the identification information of the object 10 may includea gender, an age, a height, a weight, and a schedule for today of theobject 10. Also, examples of the health care history information of theobject 10 may include preferred content information from among A/Vcontent indicated by a health care history of the object 10, andpreferred environment information (e.g., a temperature, humidity, or anilluminance) around the apparatus 100. Health care information may beinformation that is generated based on the health care history of theobject 10, information that is manually set in real time by a healthcare professional, or information that is automatically set by a healthcare system.

If the identification information of the object 10 is the age of theobject 10, the controller 103 may control the sensing function of thesensor 105 to reduce an interval at which the sensor 105 measures an ECGin proportion to the age of the object 10. That is, as the age of theobject 10 increases, an interval at which an ECG is measured maydecrease, in order to prevent an abrupt heart attack in old age may beprevented by reducing an ECG measurement interval.

The controller 103 may determine a first wake-up time of the object 10based on schedule information of the object 10 and may change the firstwake-up time to a second wake-up time by taking into account sleep stateinformation of the object 10.

The controller 103 may determine an alarm condition corresponding to asleep depth of the object 10. For example, the controller 103 maydetermine an alarm cycle, an alarm intensity, and an alarm typeaccording to the sleep depth of the object 10. Also, the controller 103may determine the alarm condition according to the sleep depth of theobject 10 and an urgency of an alarm content.

When a noise signal is detected within a predetermined distance from theobject 10 who is sleeping, the controller 103 may analyze the noisesignal and may determine a noise pattern having periodiccharacteristics. The controller 103 may control the output device 111 tooutput an anti-phase noise pattern having a phase that is opposite tothat of the determined noise pattern. In this case, noise around theobject 10 may be removed or reduced.

The power supply 104 may change a power state of a customized bed fromthe stand-by mode to the active mode or from the active mode to thestand-by mode under the control of the controller 103.

The sensor 105 may obtain the bio-information of the object 10 under thecontrol of the controller 103. The sensor 105 may obtain informationabout a body state of the object 10 (e.g., the sleep state informationwhen the object 10 is sleeping) by measuring a bio-signal of the object10,

The user interface 106 may receive selection information about whetherthe bio-information of the object 10 is measured, and selectioninformation about whether the portable terminal 310 and the wearableterminal 320 that are located at a remote place are connected to theserver 330. The user interface 106 may receive control information forenabling the object 10 to manually control the apparatus 100.

The communicator 107 may download the personal information of the object10 from another device under the control of the controller 103. Also,the communicator 107 may receive information from the other device. Forexample, when the object 10 is in an emergency, the communicator 107 mayreceive information about an action to be taken by the object 10 fromthe portable terminal 310, the wearable terminal 320, or the server 330.

The storage 108 may store a program for processing and controlling thecontroller 103, and may store input/output data (e.g., thebio-information of the object 10, the sleep state information of theobject 10, and the schedule information of the object 10).

The storage 108 may include at least one type of storage medium selectedfrom among a flash memory type, a hard disk type, a multimedia cardmicro type, a card type memory (e.g., an SD or XD memory), random-accessmemory (RAM), static RAM (SRAM), read-only memory (ROM), electricallyerasable programmable read-only memory (EEPROM), programmable read-onlymemory (PROM), a magnetic memory, a magnetic disk, and an optical disk.The apparatus 100 may run a web storage or a cloud server that performsa storage function of the storage 108 on the Internet. Programs that arestored in the storage 108 may be classified into a plurality of modulesaccording to functions of the programs.

FIG. 3B is a view illustrating an outer appearance of the apparatus 100,according to an exemplary embodiment.

The apparatus 100, including the controller 103, may be located aroundthe object 10, who is sleeping. For example, the apparatus 100 may beattached to a bed. However, one or more exemplary embodiments are notlimited thereto. For example, the apparatus 100 may be included in theIoT hub 200, may be included in the display device 230, or may beattached to a pillow. Also, the apparatus 100 may be any apparatusappropriate for obtaining information about the object 10.

According to an exemplary embodiment, the apparatus 100 may be connectedto the portable terminal 210 (e.g., a smartphone, a wearable glass, or asmart watch) of the object 10. For example, the apparatus 100 may beconnected to IoT devices such as a washing machine, a coffee machine, arefrigerator, a robot cleaner, an air conditioner, a humidifier, and alighting device. The apparatus 100 may be connected in a wired orwireless manner to the IoT devices. Also, the apparatus 100 may beindirectly connected to the IoT devices through a home network or theIoT hub 200, or may be directly connected to the IoT devices.

The sensor 105 may be located inside or outside the apparatus 100. Thesensor 105 may be separate from the controller 103 of the apparatus 100and may be located in a mattress. Alternatively, the sensor 105 may belocated in the pillow, may be located on a wrist or an ankle of theobject 10, or may be located at an edge of the bed.

The sensor 105 may be connected in a wired or wireless manner to theapparatus 100. The sensor 105 may be connected to the apparatus 100 in awired manner through a cable, or in a wireless manner using near-fieldwireless communication such as Bluetooth, ZigBee, or Wi-Fi Direct.

FIG. 4 is a block diagram of the sensor 105 of the apparatus 100,according to an exemplary embodiment.

The sensor 105 of the apparatus 100 may include an EEG sensor 410, anECG sensor 420, a heartrate sensor 430, an oxygen saturation sensor 440,a blood pressure sensor 450, an image sensor 460, and a blood sugarsensor 470. The elements shown in FIG. 4 are exemplarily, and the sensor105 may include additional, alternative, or fewer elements than thoseillustrated in FIG. 4. Also, the elements of FIG. 4 may be provided inan external device, instead of being included in the apparatus 100.

The EEG sensor 410 includes a sensor that may electrically detect an EEGof the object 10. The ECG sensor 420 includes a sensor that may detectan ECG that is a record of electric current that is generated by a heartmuscle during each heartbeat. The heartrate sensor 430 includes a sensorthat may measure a heart rate per unit time. The oxygen saturationsensor 440 includes a sensor that may detect oxygen saturation in theblood of the object 10 either by using an oximeter or by using an oxygendissociation curve. The blood pressure sensor 450 may include a sensorthat may measure blood pressure of the object 10 by using a directmethod or a compression method. The direct method is a method involvingdirectly inserting a tube into a carotid artery and measuring bloodpressure by using a pressure gauge that is connected to the tube. Thecompression method is a method involving measuring blood pressure bymeasuring a pressure that changes or blocks the flow of blood. The imagesensor 460 may include a device for capturing an image of the object 10.The image sensor 460 may include at least one of an infrared camera anda depth camera. The infrared camera refers to a camera that may obtainan image by detecting infrared rays. The depth camera refers to a camerathat may detect a depth value from the depth camera to the object 10.The blood sugar sensor 470 includes a sensor that may measure a bloodsugar level of the object 10 by measuring glucose or the like in blood.

The sensor 105 may include a microphone for detecting a snoring sound,an odor sensor or an alcohol sensor for measuring an alcoholconcentration of the object 10, a motion sensor for detecting a movementof the object 10, a temperature sensor for measuring a temperature ofthe object 10, and a humidity sensor for measuring the amount of emittedsweat. According to an exemplary embodiment, the humidity sensor maymeasure the amount of emitted sweat of the object 10 by measuring achange in the amount of moisture of a sheet that contacts the object 10.

Also, the apparatus 100 according to an exemplary embodiment may furtherinclude a critical information storage 400, e.g., a critical informationstorage unit. The critical information storage 400 stores referencebio-information that is compared with the bio-information that isobtained through the sensor 105. For example, the referencebio-information may include a first critical value and a second criticalvalue that are compared with the bio-information. When a value that isincluded in the bio-information is greater than the first critical valueand is less than the second critical value, the controller 103 maycontrol the communicator 107 to transmit a first alarm signal that isstored in the storage 108 to a near-field connection device usingnear-field communication. When a response signal to the first alarmsignal is not received or the value that is included in the obtainedbio-information is greater than or equal to the second critical value,the controller 103 may transmit a second alarm signal that is stored inthe storage 108 to a far-field connection device using far-fieldcommunication.

FIG. 5 is a view illustrating a system for monitoring the object 10 in ahospital, according to an exemplary embodiment.

When the apparatus 100 is installed in the hospital, the apparatus 100may obtain information about a state of the object 10. For example, theapparatus 100 may obtain information about at least one of an EEG, anECG, a heart rate, an oxygen saturation, a blood pressure, a movement, ablood sugar level, a respiration movement, a body temperature, a sleepdepth, and a sleep pattern that are sensed through the sensor 105. Theapparatus 100 may transmit the obtained information to a portableterminal 520 of a doctor in charge, a monitor for patients 510, or amonitor for medical personnel 530. Information that is displayed on themonitor for patients 510 and information that is displayed on theportable terminal 520 of the doctor in charge or the monitor for medicalpersonnel 530 may be different from each other.

Also, the apparatus 100 may control devices such as an air conditioner540, an air cleaner 550, a heater 560, and a lighting device 570 thatare connected to a hospital network in order to control an environmentaround the object 10 based on the obtained information.

FIGS. 6 through 8 will be explained based on the assumption that theapparatus 100 is included in the display device 230. According to anexemplary embodiment, the display device 230 may measure informationabout a heart rate or a respiration movement of the object 10 based ondepth information or an infrared image that is obtained through thecamera 232.

FIG. 6 is a view illustrating a system used by the display device 230 tomonitor the object 10, according to an exemplary embodiment. Anoperation performed by the display device 230 to measure the informationabout the heart rate or the respiration will be explained below indetail with reference to FIGS. 7 and 8.

The display device 230 may calculate a similarity between a currentsleep pattern of the object 10 and an abnormal sleep pattern that isstored in the storage 108 by using the information about the heart rateor the respiration movement. If it is determined that the current sleeppattern of the object 10 is an abnormal pattern, the display device 230may output a message or a voice signal for notifying the object 10 of anemergency, and may transmit a message for notifying a terminal 610 of afamily member of the object 10 of the emergency. Also, when there is noadditional response to the operation, the display device 230 mayautomatically notify a server 630 of a closest emergency center or apredetermined medical institute of a state of a patient.

Also, the display device 230 may control devices such as the airconditioner 250, the air cleaner 260, the heater 270, and the lightingdevice 280 that are connected to a home network in order to control anenvironment around the object 10 based on the information about theheart rate or the respiration movement. For example, when a sleep depthof the object 10 is low, the display device 230 may further reduce anilluminance of a room by controlling the lighting device 280.

FIG. 7 is a flowchart illustrating a method performed by the displaydevice 230 to determine a heart rate/respiration rate, according to anexemplary embodiment.

In operation S710, the display device 230 may obtain an object image byusing the camera 232. For example, the display device 230 may obtain aninfrared image or a depth image.

The display device 230 may detect infrared radiation that is radiatedfrom a solid object by using an infrared camera, may change a radianttemperature of the solid object into an electrical signal, and mayobtain a two-dimensional (2D) visible image (i.e., an infrared image).

Also, the display device 230 may measure a depth value of the object 10by using a depth camera, may image the measured depth value, and maygenerate a depth image.

In operation S720, the display device 230 may analyze the obtainedimage. In operations S730 and S735, the apparatus 100 may determine aheart rate and a respiration rate based on a result of the analysis ofthe obtained image.

For example, the display device 230 may measure the heart rate of theobject 10 by comparing frames of the infrared image. In particular, thedisplay device 230 may determine the heart rate of the object 10 bycomparing feature points or feature vectors around an artery in theinfrared image with each other.

Also, the display device 230 may determine the respiration rate bycomparing frames of the depth image. For example, since the chestrepeatedly expands and contracts as the object 10 breathes, the displaydevice 230 may determine the respiration rate by tracking a change inthe chest in the depth image.

According to an exemplary embodiment, the display device 230 may obtainsleep information of the object 10. For example, the display device 230may obtain information about a snoring pattern of the object 10 by usinga microphone. Also, the display device 230 may obtain information abouta change in a body temperature of the object 10 by using the infraredimage. The display device 230 may obtain information about the amount ofemitted sweat, information about how the object 10 turns over duringsleep, and information about an EEG of the object 10 from an externalsensor.

In operation S740, the display device 230 may analyze a state of theobject 10.

According to an exemplary embodiment, the display device 230 maycalculate a similarity between a current sleep pattern of the object 10and an abnormal sleep pattern that is stored in the storage 108. As aresult of the calculation, when the similarity between the current sleeppattern of the object 10 and the abnormal sleep pattern that is storedin the storage 108 is high (for example, greater than or equal to 95%),it may be determined that the object 10 is in a bad state.

For example, when the measured heart rate is less than or equal to aminimum critical heart rate or greater than or equal to a maximumcritical heart rate, the display device 230 may determine that the heartrate of the object 10 is abnormal. Also, when the respiration rate ofthe object 10 per minute is less than or equal to a critical value, thedisplay device 230 may determine that the object 10, who is sleeping, isin an apnea state.

In operation S750, the display device 230 may transmit an alarm signalto a near-field connection device or a far-field connection deviceaccording to the state of the object 10.

If it is determined that the current sleep pattern of the object 10 isan abnormal sleep pattern, the display device 230 may output a messageor a voice signal for notifying the object 10 of an emergency. Also, thedisplay device 230 may transmit a message for notifying the terminal 610of a family member of the object 10 of the emergency. When there is noresponse within a predetermined period of time after the message istransmitted to the terminal 610 of the other family member, the displaydevice 230 may automatically notify the server 630 of a closestemergency center or a predetermined medical institute of the state ofthe object 10. For example, when there is no access of a third person tothe object 10 within 5 minutes after the message is transmitted to theterminal 610 of the family member, the display device 230 may transmitan emergency rescue message including the state of the object 10 to theserver 630 of the emergency center or the predetermined medicalinstitute.

According to another exemplary embodiment, the display device 230 maytransmit the alarm signal to the near-field connection device or thefar-field connection device according to a seriousness of the state ofthe object 10. For example, when the object 10 is in a sleep hypopneastate (e.g., a state where there is a 50% reduction in air flow and a 4%decrease in oxygen saturation that lasts for 10 seconds or longer), thedisplay device 230 may transmit the alarm signal to the near-fieldconnection device. The near-field connection device that is a devicelocated around the display device 230 may transmit/receive a signalusing near-field communication with the display device 230. In contrast,when a sleep apnea state of the object 10 lasts for 30 seconds or more,the display device 230 may transmit the alarm signal to the far-fieldconnection device, instead of the near-field connection device. Examplesof the far-field connection device may include an emergency centerserver, a medical institute server, and a designated terminal of adoctor.

FIG. 8 is a view illustrating a method performed by the display device230 to determine a heart rate/respiration rate, according to anexemplary embodiment.

In operation S810, the display device 230 may obtain an image of theobject 10 by using the camera 232. In this case, the camera 230 may be adepth camera. For example, the depth camera may measure a depth value ofthe object 10 (specifically, the chest). The depth camera may include anIR light source and a three-dimensional (3D) depth sensor.

According to an exemplary embodiment, the depth sensor may obtain thedepth value of the object 10 by using various methods. For example, thedepth sensor may measure the depth value by using at least one of atime-of-flight (TOF) method, a stereoscopic vision method, and astructured light pattern method.

The TOF method refers to a method of measuring a distance to a solidobject by analyzing a time taken for light to be reflected from thesolid object and return. In a TOF system, an infrared light-emittingdiode (LED) emits infrared light and an infrared camera measures a timetaken for light to be reflected from a solid object and return to theinfrared camera. The depth sensor may include an infrared LED and aninfrared camera. The depth sensor may obtain distance information as amoving image by repeatedly emitting and receiving light, for example,ten or more times per second. Also, the depth sensor may generate adepth map representing distance information by using a brightness or acolor of each pixel.

The stereoscopic vision method refers to a method of obtaining astereoscopic image of a solid object by using two cameras. In this case,the depth sensor may include two cameras. The depth sensor may calculatea distance based on the principle of triangulation by using differenceinformation between images of the two cameras. A person perceives adepth based on a difference between images projected to the right andleft eyes, and the depth sensor measures a distance by using a methodsimilar to that of human eyes. For example, when a distance is short, adifference between images obtained by the two cameras is large, and whena distance is long, a difference between images obtained by the twocameras is small.

The structured light pattern method refers to a method of measuring adistance to a solid object by analyzing a position of a pattern that isformed on the solid object. The depth sensor generally projects a linearpattern or a point pattern to a solid object, and the linear pattern orthe point pattern varies according to a curve of the solid object.

The structured light pattern method may be performed by replacing one ofthe two cameras that is used in the stereoscopic vision method with alight projector. For example, the depth sensor may calculate in realtime a depth map by analyzing, using an algorithm, a position of apattern that is formed when light emitted from an infrared projector isprojected onto a surface of a solid object.

In operations S820 and S822, the display device 230 may determine aheart rate of the object 10 by using an infrared image.

In operation S830, the display device 230 may measure a respirationmovement by using depth information of the object 10. For example, thedisplay device 230 may obtain respiration information (e.g., arespiration rate, a respiration volume, and/or a respiration cycle) ofthe object 10.

In operation S840, the display device 230 may analyze a sleep pattern ofthe object 10 based on the heart rate and the respiration information ofthe object 10.

In operation S850, as a result of the analysis of the sleep pattern,when it is determined that the sleep pattern of the object 10 isabnormal, the display device 230 may determine that the object 10 is inan emergency, and may make a call or transmit a message to apredetermined hospital server 800.

Operations S810 through S850 respectively correspond to operations S710through S750 of FIG. 7.

Although the display device 230 obtains the heart rate information andthe respiration information by using the camera 232 in FIGS. 6 through8, one or more exemplary embodiments are not limited thereto. Forexample, a smart watch or a separate sensor may obtain the heart rateinformation or the respiration information.

FIG. 9 is a flowchart illustrating a method performed by the apparatus100 to adjust a wake-up time, according to an exemplary embodiment.

In operation S910, the apparatus 100 may determine a first wake-up timeof the object 10. The term ‘wake-up time’ used herein may be a time atwhich a wake-up alarm signal is transmitted to the object 10. Also, theobject 10 may refer to a person who is sleeping.

According to an exemplary embodiment, the first wake-up time may be afixed value or a variable value. For example, the first wake-up time maybe an average wake-up time of the object 10, or a target wake-up timethat is designated by the object 10.

According to an exemplary embodiment, the apparatus 100 may determinethe first wake-up time of the object 10 based on object information.According to an exemplary embodiment, the object information may includeat least one of average wake-up time information (e.g., 7 AM), wake-uptime information before going to sleep (e.g., 6 AM), bedtime information(e.g., 10 PM), schedule information before going to sleep (e.g., diningout, night work, tennis for 1 hour, and swim for 30 minutes), bloodalcohol level information before going to sleep (e.g., 0.02%), bodytemperature information before going to sleep (e.g., 36.5° C.), heartrate information before going to sleep (e.g., 70 times/minute),identification information (e.g., a gender, an age, a height, and aweight), and health care history information (e.g., a blood pressure, ablood sugar level, and a cancer treatment history) of the object 10.

For example, when a blood alcohol level of the object 10 before going tosleep is higher than or equal to 0.03%, the apparatus 100 may determine7:10 that is 10 minutes later than the average wake-up time (e.g., 7 AM)as the first wake-up time. Also, when the object 10 swims before goingto sleep, the apparatus 100 may determine 7:30, which is an averagewake-up time the day after the object 10 swam, as the first wake-uptime.

In operation S920, the apparatus 100 may obtain sleep state informationof the object 10 who is sleeping. The sleep state information that isinformation related to a sleep of the object 10 may include, asnon-limiting examples, bio-information of the object 10 who is sleeping,environment information around the object 10 who is sleeping, andanalysis information obtained by analyzing the bio-information of theobject 10. For example, the sleep state information may include, asnon-limiting examples, at least one of heart rate information,respiration information, movement information (e.g., the number of timesthe object 10 changes his/her posture during sleep), snoring patterninformation, iris movement information, EEG information, emitted sweatinformation, blood pressure information, blood sugar level information,oxygen saturation information (SpO₂), and body temperature informationof the object 10.

According to an exemplary embodiment, the apparatus 100 may obtain thebio-information from the wearable terminal 220. For example, theapparatus 100 may obtain pulse information, body temperatureinformation, and/or blood pressure information of the object 10 who issleeping from a smart band or a smart watch. Also, the apparatus 100 mayreceive body temperature information and/or emitted sweat informationfrom sleep socks. The apparatus 100 may receive respiration information,pulse information, body temperature information, and/or blood pressureinformation from a sensor system (e.g., the sensor 105) that is locatedunder a mattress. According to an exemplary embodiment, the sensorsystem may be of a sheet type including at least two sensors.

According to an exemplary embodiment, the apparatus 100 may obtain sleepstate information by analyzing the bio-information of the object 10 thatis received from the wearable terminal 220 that is an external terminal.The apparatus 100 may receive from the wearable terminal 220 sleeppattern information of the object 10 that is obtained by analyzing thebio-information received from the wearable terminal 220.

According to an exemplary embodiment, the apparatus 100 may receiveenvironment information around the object 10 who is sleeping from IoTdevices.

The IoT device may store service information related to a service thatis provided by the IoT device. For example, the IoT device may include aspace (e.g., a memory or a disk) in which sensor data that is collectedby the sensor or user use history data is stored.

According to an exemplary embodiment, the apparatus 100 may obtaintemperature information and/or humidity information from the airconditioner 250. The apparatus 100 may receive fine dust concentrationinformation, humidity information, and/or temperature information fromthe air cleaner 260.

According to an exemplary embodiment, the apparatus 100 may obtain animage of the object 10 from the camera 232 (e.g., a depth camera or aninfrared camera) that is included in the display device 230 (e.g., aTV). In this case, the image of the object 10 may be a still image or amoving image. The apparatus 100 may analyze the image of the object 10,and may obtain heart rate information or respiration information (e.g.,a respiration rate, a respiration cycle, or a respiration volume) of theobject 10. For example, the apparatus 100 may receive infrared imageinformation of the object 10 from the display device 230. The apparatus100 may obtain the heart rate information of the object 10 based on theinfrared image information.

Also, since the chest repeatedly expands and contracts as the object 10breathes, the apparatus 100 may obtain the respiration information ofthe object 10 by comparing feature vectors that are included in aplurality of frames with each other.

In operation S930, the apparatus 100 may change the first wake-up timeto a second wake-up time by taking into account the sleep stateinformation of the object 10.

For example, when the number of times the object 10 changes a posture isgreater than or equal to a critical number of times (e.g., 30 times),the apparatus 100 may change a target wake-up time from 7 AM to 7:10 AMAlso, when the number of times the object 10 changes a posture isgreater than or equal to the critical number of times (e.g., 30 times),an apnea cycle of the object 10 is twice or more longer than an averageapnea cycle, and a body temperature is higher than or equal to 38° C.,the apparatus 100 may adjust the target wake-up time from 7 AM to 7:30AM

According to an exemplary embodiment, the first wake-up time and thesecond wake-up time may be earlier than a critical time. The criticaltime may be preset by the object 10 or may be preset by an externaldevice. For example, when the object 10 has to wake up by 8 AM at thelatest, the object 10 may set the critical time to 8 AM. Also, when amobile phone of the object 10 analyzes a time for work of the object 10and determines that the object 10 usually leaves home before 8:10 AM,the mobile phone may set the critical time to 8 AM in the apparatus 100.

According to an exemplary embodiment, the apparatus 100 may delay oradvance the target wake-up time according to a sleep state of the object10, before or by the critical time.

In operation S940, the apparatus 100 may compare a current time with thesecond wake-up time and may determine whether the current time reachesthe second wake-up time.

When the current time does not reach the second wake-up time, theapparatus 100 may again obtain the sleep state information of the object10. For example, the apparatus 100 may monitor the sleep state of theobject 10 by using at least one of the bio-information of the object 10that is received from the wearable terminal 220 or a sensor that isembedded in the apparatus 100, the environment information that isreceived from the IoT device, and the image information of the object 10that is received from the camera 232.

In operation S950, the apparatus 100 may output a wake-up alarm signalat the second wake-up time. The wake-up alarm signal may be a signal forinducing a wake-up of the object 10. For example, the wake-up alarmsignal may include, as non-limiting examples, at least one of an audiosignal, a video signal, a vibration signal, a smell signal, and a touchsignal. According to an exemplary embodiment, the apparatus 100 mayoutput the wake-up alarm signal by using a vibration motor, a display,e.g., a display unit, or a speaker that is included in the apparatus100.

According to an exemplary embodiment, the apparatus 100 may output thewake-up alarm signal at the second wake-up time through an externaldevice. For example, the apparatus 100 may output the wake-up alarmsignal through a display device (e.g., a TV) or an alarm clock.

Also, the apparatus 100 may open a window through the window controller270, may change an illuminance or a color in a room by using thelighting device 280, or may output a preset sound through the audiooutput device 240. Also, the apparatus 100 may activate a fan of the airconditioner 250, or may move an air cell or a mechanical frame of a bed.

According to an exemplary embodiment, the apparatus 100 may set anoptimum wake-up time according to the sleep state of the object 10 bymonitoring the sleep state of the object 10. Also, the apparatus 100 mayoutput the wake-up alarm signal so that the object 10 may wake up at atime at which the object 10 has the best condition.

According to an exemplary embodiment, when a plurality of objects are ina bed, the apparatus 100 may adjust wake-up times according to theplurality of objects. For example, a target wake-up time before going tosleep of each of a first object and a second object may be 7:30 AM Inthis case, when an apnea cycle of the first object who is sleeping istwice or more longer than a usual apnea cycle, the apparatus 100 mayadjust the target wake-up time of the first object from 7:30 AM to 8 AMWhen it is 7:30 AM, the apparatus 100 may output a second wake-up alarmsignal corresponding to the second object, and when it is 8 AM, theapparatus 100 may output a first wake-up alarm signal corresponding tothe first object. The second wake-up alarm signal and the first wake-upalarm signal may be different signals in which preferences of the secondobject and the first object are respectively reflected. For example, thefirst wake-up alarm signal and the second wake-up alarm signal may besignals for outputting different songs. Alternatively, the first wake-upalarm signal may be a signal for making a vibration from a smart watchthat is worn on a wrist of the first object, and the second wake-upalarm signal may be a signal for outputting radio news from an audiooutput device of the second object.

According to an exemplary embodiment, the apparatus 100 may measure anactual wake-up time of the object 10, the apparatus 100 may determine aremaining time (e.g., 30 minutes) from the actual wake-up time (e.g.,7:30 AM) of the object 10 to a preset critical time (e.g., 8 AM). Theapparatus 100 may select at least one activity to be performed by theobject 10 for the remaining time. The apparatus 100 may provideinformation about the selected at least one activity.

For example, it is assumed that the object 10 wakes up at 7 AM, leaveshome at 8 AM, and needs a preparation time of 1 hour before going towork. When the object 10 wakes up at 7:30 AM, the apparatus 100 maydetermine that there is only a remaining time of 30 minutes. In thiscase, the apparatus 100 may transmit to the object 10 informationindicating that taking a shower, washing hair, and eating breakfast,from among things generally done during the preparation time beforegoing to work, should be omitted. Also, the apparatus 100 may transmitto the object 10 schedule information indicating that only washing face,shaving, getting dressed, packing bag, and drinking milk, from among thethings generally done during the preparation time before going to work,should be performed. According to an exemplary embodiment, as theremaining time decreases, the number of things selected by the apparatus100 may decrease.

According to an exemplary embodiment, the apparatus 100 may displayinformation about the selected at least one schedule on an externaldisplay device (e.g., a TV).

Although the apparatus 100 changes the target wake-up time of the object10 in FIG. 9, one or more exemplary embodiments are not limited thereto.According to an exemplary embodiment, a server that is connected to theapparatus 100 may obtain the sleep pattern information of the object 10through the apparatus 100 and may change the target wake-up time basedon the sleep pattern information. The server may also transmitinformation about the changed target wake-up time to the apparatus 100.

FIG. 10 is a flowchart illustrating a method performed by the apparatus100 to control a peripheral device according to a sleep state of theobject 10, according to an exemplary embodiment.

In operation S1010, the apparatus 100 may determine a schedule of theobject 10. For example, the apparatus 100 may determine whether theobject 10 exercised before going to sleep, whether the object 10 drankalcohol before going to sleep, or whether the object 10 drank coffee ina coffee shop before going to sleep, based on schedule informationrecorded by the object 10, context information (e.g., positioninformation) of the object 10, or bio-information of the object 10.Also, the apparatus 100 may determine a next day's schedule of theobject 10. For example, the apparatus 100 may determine whether theobject 10 has a meeting in the morning, has a business trip in themorning, or has a day-off.

In operation S1020, the apparatus 100 may determine a target wake-uptime based on the schedule before going to sleep or the next day'sschedule of the object 10. For example, when the object 10 rode abicycle before going to sleep, the apparatus 100 may determine 7:30 AM,which is 30 minutes later than a usual wake-up time, as the targetwake-up time. Also, when the object 10 rode a bicycle before going tosleep but there is a meeting at 8 AM the next day, the apparatus 100 maydetermine 7 AM as the target wake-up time.

In operation S1030, the apparatus 100 may determine a sleep state of theobject 10. For example, the apparatus 100 may determine whether thesleep state of the object 10 is normal by using the bio-information ofthe object 10 and/or environment information (e.g., a temperature,humidity, luminance, or noise in a room) around the object 10. If it isdetermined that the sleep state of the object 10 is normal, the methodproceeds to operation S1050. In operation S1050, the apparatus 100 maydetermine whether a current time reaches the target wake-up time.

If it is determined in operation S1030 that the sleep state of theobject 10 is not normal, the method proceeds to operation S1040. Inoperation S1040, the apparatus 100 may control a peripheral device inorder to improve the sleep quality of the object 10. For example, theapparatus 100 may adjust a temperature in a bedroom by using the airconditioner 250 or may adjust humidity in the bedroom by using adehumidifier. Also, the apparatus 100 may change an illuminance or acolor in the bedroom by using the lighting device 280. When an apneatime of the object 10 is greater than or equal to a critical value(e.g., 20 seconds), the apparatus 100 may wake up the object 10 byoutputting a sound.

In operation S1050, the apparatus 100 may determine whether the currenttime reaches the target wake-up time. If it is determined in operationS1050 that the current time does not reach the target wake-up time, themethod returns to operation S1030. In operation S1030, the apparatus 100may monitor again the sleep state of the object 10 to further monitorthe sleep state of the object 10.

If it is determined in operation S1050 that the current time reaches thetarget wake-up time, the method proceeds to operation S1060. Inoperation S1060, the apparatus 100 may output a wake-up alarm signal.For example, the wake-up alarm signal may include, as non-limitingexamples, at least one of an audio signal, a video signal, a vibrationsignal, a smell signal, and a touch signal. According to an exemplaryembodiment, the apparatus 100 may output the wake-up alarm signal byusing a vibration motor, a display, or a speaker that is included in theapparatus 100. Also, the apparatus 100 may wake up the object 10 byspraying a specific air freshener or water preferred by the object 10.

According to an exemplary embodiment, the apparatus 100 may output thewake-up alarm signal at the target wake-up time through an externaldevice. For example, the apparatus 100 may output the wake-up alarmsignal (e.g., may display an alarm image or may output an alarm sound)through the display device 230 (e.g., a TV), the portable terminal 210,the wearable terminal 220, or an alarm clock. Also, the apparatus 100may open a window through the window controller 270, may change anilluminance or a color in a room by using the lighting device 280, ormay output a preset sound through the audio output device 240. Also, theapparatus 100 may cause wind to blow through the air conditioner 250 ormay move an air cell and a mechanical frame of a bed.

FIG. 11 is a flowchart illustrating a method of monitoring the object 10who is sleeping, according to an exemplary embodiment.

In operation S1110, the apparatus 100 may obtain (or collect)bio-information of the object 10 who is sleeping.

In operation S1120, the apparatus 100 may compare the obtainedbio-information with reference bio-information. According to anexemplary embodiment, the reference bio-information may include acritical value that is set based on a clinical test. According to anexemplary embodiment, the reference bio-information may include acritical value that is set based on personal measurement information ofthe object 10. According to an exemplary embodiment, the referencebio-information may vary according to an age, a gender, and a body sizeof the object 10.

According to an exemplary embodiment, the reference bio-information mayinclude, as non-limiting examples, at least one of a referencetemperature value, a reference respiration rate value, a referencesignal saturation value, and a reference apnea cycle value. According toan exemplary embodiment, the reference bio-information may include aplurality of critical values.

If it is determined in operation S1120 that a value that is included inthe obtained bio-information is greater than a first critical value andis less than a second critical value, wherein the first and secondcritical values are included in the reference bio-information, themethod proceeds to operation S1130. In operation S1130, the apparatus100 may transmit a first alarm signal related to the obtainedbio-information to near-field connection devices. The near-fieldconnection devices may be devices that are located in a near-fieldcommunication zone of the apparatus 100.

According to an exemplary embodiment, the apparatus 100 may select atleast one near-field connection device for adjusting the value that isincluded in the obtained bio-information. The apparatus 100 may transmita control signal for controlling a predetermined function to theselected at least one near-field connection device. For example, when abody temperature of the object 10 is higher than or equal to 38° C., theapparatus 100 may select the air conditioner 250, the ventilator 290,and the window controller 270 to reduce the body temperature of theobject 10. The apparatus 100 may transmit a control signal for reducinga set temperature to the air conditioner 250, may transmit a controlsignal for increasing a rotation speed to the ventilator 290, and acontrol signal for opening a window to the window controller 270.

In operation S1140, the apparatus 100 may determine whether the valuethat is included in the obtained bio-information reaches the secondcritical value that is included in the reference bio-information. Thesecond critical value may be a value indicating that the object 10 is ina worse state than that of the first critical value. For example, thefirst critical value may be a ‘body temperature of 38° C.’ and thesecond critical value may be a ‘body temperature of 40° C.’.

If it is determined in operation S1140 that the value that is includedin the obtained bio-information is greater than or equal to the secondcritical value, the method proceeds to operation S1150. In operationS1150, the apparatus 100 may transmit a second alarm signal related tothe obtained bio-information to a far-field connection device. In thiscase, the apparatus 100 may also transmit the second alarm signalrelated to the obtained bio-information to the near-field connectiondevice. The far-field connection device may include a medical instituteserver or a designated terminal of a doctor.

According to an exemplary embodiment, the apparatus 100 may receivediagnosis information and guide information from the far-fieldconnection device in response to the second alarm signal. For example,the apparatus 100 may receive information about a device for diagnosingthe object 10 or a drug for emergency treatment from the far-fieldconnection device.

According to one exemplary embodiment, when the value that is includedin the obtained bio-information is greater than or equal to the secondcritical value, the apparatus 100 may obtain an image of the object 10by using the camera 232. For example, when a body temperature of theobject 10 is higher than or equal to 40° C., the apparatus 100 maycapture an image of the object 10 by controlling the camera 232. In thiscase, the image of the object 10 may be a still image or a moving image.

The apparatus 100 may transmit the obtained image of the object 10 tothe far-field connection device. According to an exemplary embodiment,the apparatus 100 may prevent a private life of the object 10 from beingcontinuously exposed by activating the camera 232 only when it isdetermined that the object 10 is in an emergency and transmitting theimage of the object 10 to an external server. Also, the apparatus 100may reduce power consumed by the camera 232.

According to an exemplary embodiment, when the object 10 is in a normalstate, the apparatus 100 may use the image of the object 10 that isobtained through the camera 232 to analyze a sleep pattern of the object10, but may not store the image of the object 10 in a memory. However,when it is determined that the object 10 is in an emergency, theapparatus 100 may store the image that is obtained through the camera232 and may transmit the image to the external server.

According to an exemplary embodiment, the apparatus 100 may periodicallytransmit the image of the object 10 to the external server.

According to an exemplary embodiment, when the value that is included inthe obtained bio-information is greater than the first critical valueand is less than the second critical value, the apparatus 100 maytransmit the first alarm signal related to the obtained bio-informationto the near-field connection device. When a response signal to the firstalarm signal is not received from the near-field connection device for apredetermined period of time, the apparatus 100 may transmit the secondalarm signal related to the obtained bio-information to the far-fieldconnection device.

FIG. 12 is a timing diagram illustrating a method performed by theapparatus 100 to communicate with at least one of a near-fieldconnection device and a far-field connection device, according to anexemplary embodiment.

1200-1 of FIG. 12 is a case where a value that is included in obtainedbio-information of the object 10 is greater than a first critical valueand is less than a second critical value that are included in referencebio-information.

In operation S1210, when the value that is included in the obtainedbio-information is greater than the first critical value and is lessthan the second critical value that are included in the referencebio-information, the apparatus 100 may transmit the bio-information ofthe object 10 and a control signal to a near-field connection device1202.

In operation S1220, the apparatus 100 may receive a control completionsignal from the near-field connection device 1202. In this case, theapparatus 100 may not transmit the bio-information of the object 10 to afar-field connection device 1204.

1200-2 of FIG. 12 is a case where the value that is included in theobtained bio-information of the object 10 is greater than the secondcritical value that is included in the reference bio-information.

In operation S1232, the apparatus 100 may transmit the bio-informationof the object 10 and the control signal to the near-field connectiondevice 1202. In operation S1234, the apparatus 100 may transmit thebio-information of the object 10 and an alarm signal to the far-fieldconnection device 1204. For example, since the value that is included inthe bio-information of the object 10 is greater than the second criticalvalue, the apparatus 100 may determine that the object 10 is in a badstate and may transmit the alarm signal indicating a state of the object10 and the bio-information of the object 10 to the far-field connectiondevice 1204 as well as the near-field connection device 1202.

In operation S1242, the apparatus 100 may receive a control completionsignal from the near-field connection device 1202. In operation S1244,the apparatus 100 may receive a reception completion signal from thefar-field connection device 1204.

A method performed by the apparatus 100 to improve the sleep quality ofthe object 10 by monitoring a sleep state of the object 10 and anambient environment will now be explained.

FIG. 13 is a flowchart illustrating a method of adjusting a curtain or ablind according to a brightness of light, according to an exemplaryembodiment.

In operation S1310, the apparatus 100 may measure a brightness of lightaround the object 10 who is sleeping. For example, the apparatus 100 maymeasure a brightness of light by using an illumination sensor (e.g., anRGB sensor) in a bedroom.

The apparatus 100 may continuously or periodically measure a brightnessof light by using the illumination sensor. Also, the apparatus 100 mayactivate the illumination sensor only for a specific period of time. Forexample, the apparatus 100 may measure a brightness of light byactivating the illumination sensor only from 5 AM to 8 PM.

In operation S1320, the apparatus 100 may determine whether the measuredbrightness of light is greater than a preset critical value. Thecritical value may be set by the object 10 or may be preset in theapparatus 100.

For example, the critical value may be 30 lux. Although each person hashis/her own favorite brightness in a bedroom, according to a study on arelationship between a brightness and sleep quality, when a brightnessis greater than or equal to 30 lux, sleep quality may be bad, and when abrightness is greater than or equal to 100 lux, a sleep depth may bereduced.

When the brightness of light is less than the critical value (e.g., 30lux) and thus the bedroom is still dark, the apparatus 100 maycontinuously or periodically measure the brightness of light by usingthe illumination sensor.

If it is determined in operation S1320 that the brightness of light isgreater than or equal to the critical value (e.g., 30 lux), the methodproceeds to operation S1330. In operation S1330, the apparatus 100 maydetermine whether a current time is before or after a wake-up time atwhich the object 10 is to be woken up. The wake-up time at which theobject 10 has to wake up may be a fixed time (e.g., 7 AM) that isselected by the object 10 or may be a time (e.g., a time that isdetermined from 7 AM to 8 AM) that varies according to a sleep state(e.g., a sleep depth, a sleep duration, and sleep quality) of the object10.

For example, when a target wake-up time that is determined according tothe sleep state of the object 10 is 8 AM and a current time is 6:30 AM,the apparatus 100 may determine that the current time is ‘before’ thewake-up time. In contrast, when a target wake-up time that is set by theobject 10 is 6 AM and a current time is 6:03 AM, the apparatus 100 maydetermine that the current time is ‘after’ the wake-up time.

If it is determined in operation S1330 that the current time is ‘before’the wake-up time, the method proceeds to operation S1340. In operationS1340, the apparatus 100 may close a curtain by controlling the curtain.Alternatively, the apparatus 100 may lower a blind or may reduce theamount of transmitted light by controlling the blind. In this case, thebrightness of the bedroom may be reduced.

Accordingly, according to an exemplary embodiment, when the sun risesbefore the wake-up time at which the object 10 has to wake up or theobject 10 is napping, the apparatus 100 may reduce an illuminance in thebedroom in order to improve the sleep quality of the object 10.

If it is determined in operation S1330 that the current time is ‘after’the wake-up time, the method proceeds to operation S1350. In operationS1350, the apparatus 100 may open the curtain by controlling thecurtain. Alternatively, the apparatus 100 may raise the blind or mayincrease the amount of transmitted light by controlling the blind. Inthis case, the bedroom may get brighter.

Accordingly, according to an exemplary embodiment, when the object 10still sleeps even after the wake-up time, the apparatus 100 may rapidlywake up the object 10 by increasing an illuminance in the bedroom.

FIG. 14 is illustrates a method performed by the apparatus 100 tocontrol a curtain according to a brightness of light in a bedroom,according to an exemplary embodiment.

In a case 1400-1, a current time may be 6 AM and a target wake-up timethat is set in an alarm clock 1420 may be 8 AM. In this case, when theapparatus 100 measures a brightness of light at 6 AM by using anillumination sensor, the brightness in the bedroom may be 50 lux becausethe sun has risen.

Since the measured brightness in the bedroom (50 lux) is greater than acritical brightness value (30 lux) and the current time (6 AM) is beforethe target wake-up time (8 AM), the apparatus 100 may reduce anilluminance in order to improve the sleep quality of the object 10.

In a case 1400-2, the apparatus 100 may automatically close a curtain1410 by manipulating a curtain controller. The apparatus 100 maymaintain a state where the curtain 1410 is closed until the targetwake-up time (8 AM).

When time passes and the current time is 8 AM, the alarm clock 1420 mayoutput a wake-up alarm sound in order to wake up the object 10. In thiscase, since the current time (8 AM) reaches the target wake-up time (8AM), the apparatus 100 may open the curtain 1410 and may wake up theobject 10.

An operation performed by the apparatus 100 to remove noise around theobject 10 in order to improve the sleep quality of the object 10 willnow be explained in detail with reference to FIG. 15.

FIG. 15 is a flowchart illustrating a method of removing noise aroundthe object 10 by using an audio output device, according to an exemplaryembodiment.

In operation S1510, the apparatus 100 may obtain state information ofthe object 10.

For example, the apparatus 100 may collect information sensed by thesensor 105 or an external IoT device, and may analyze a state of theobject 10 based on the collected information. Also, the apparatus 100may receive from the external IoT device information about the state ofthe object 10 that is analyzed by the external IoT device.

Examples of the state of the object 10 may include, but are not limitedto, a state in which the object 10 is walking, a state in which theobject 10 is stopping, a state in which the object 10 is running, astate in which the object 10 is sleeping, a state in which the object 10is driving, a state in which the object 10 is going to work, a state inwhich the object 10 is talking (or having a conversation), a state inwhich the object 10 is exercising (e.g., jogging, swimming, playingtennis, playing basketball, or going mountain climbing), a state inwhich the object 10 is drinking liquor, a state in which the object 10stands, a state in which the object 10 sits, and a state in which theobject 10 lies.

According to an exemplary embodiment, the apparatus 100 may determinewhether the object 10 is stopping, walking, or running by using at leastone of an acceleration sensor, a tilt sensor, a position sensor, and apressure sensor. For example, when it is found by using accelerationinformation that is measured by the acceleration sensor that the object10 moves at an average speed of 0.001 km/h for a predetermined period oftime (1), the apparatus 100 may determine that the object 10 isstopping, when it is found that the object 10 moves at an average speedof 4 km/h for the predetermined period of time (2), the apparatus 100may determine that the object 10 is walking, and when it is found thatthe object 10 moves at an average speed of 15 km/h for the predeterminedperiod of time, the apparatus 100 may determine that the object 10 isrunning.

In operation S1520, the apparatus 100 may determine whether the object10 is sleeping, based on the state information of the object 10.

According to an exemplary embodiment, the apparatus 100 may determinewhether the object 10 is sleeping by using at least one of an irisrecognition sensor, an image sensor, a microphone, an accelerationsensor, and a tilt sensor. For example, when a state where a movementvalue of the object 10 that is measured by a motion sensor (e.g., anacceleration sensor, a tilt sensor, or a geomagnetic sensor) is lessthan or equal to a critical value is maintained for a predeterminedperiod of time, the apparatus 100 may determine that the object 10 issleeping.

When a value of a pressure sensor that is embedded in a pillow or amattress is greater than or equal to a critical value and a respirationpattern of the object 10 is a respiration pattern during sleep, theapparatus 100 may determine that the object 10 is sleeping. Also, when asound signal that is obtained through a microphone is analyzed and asound of a snoring pattern is detected, the apparatus 100 may determinethat the object 10 is sleeping.

When the number of times eyes of the object 10 blink which is measuredthrough an iris recognition sensor that is attached to an eye patch isless than a critical number of times (e.g., one eye blinking is detectedfor 10 minutes) or an iris is not detected for a predetermined period oftime (e.g., 5 minutes or longer), the apparatus 100 may determine thatthe object 10 is sleeping.

According to an exemplary embodiment, the apparatus 100 may capture animage of an eye of the object 10 in predetermined cycles by using animage sensor (e.g., the camera 232), and may detect a pupil byperforming edge analysis on the captured image of the eye. In this case,when the pupil is not detected in the captured image of the eye for apredetermined period of time (e.g., 5 minutes or longer), the apparatus100 may determine that the object 10 is sleeping.

There may be various other methods performed by the apparatus 100 todetermine whether the object 10 is sleeping.

If it is determined in operation S1520 that the object 10 is sleeping,the method proceeds to operation S1530. In operation S1530, theapparatus 100 may obtain noise information around the object 10.

According to an exemplary embodiment, the apparatus 100 may receive anoise signal within a predetermined distance from the object 10 throughthe audio input device (e.g., a microphone). The audio input device maybe included in the apparatus 100 or may be included in an externaldevice. Also, since the audio input device is a device for measuringnoise around the object 10, the audio input device may be located withina predetermined distance (e.g., 30 cm) from the object 10.

According to an exemplary embodiment, the apparatus 100 may determine anoise pattern having periodic characteristics by analyzing the noisesignal. The noise pattern may refer to a signal of a unit interval(e.g., a sample interval) that periodically repeats in the noise signal.

For example, when a noise signal having a periodic noise pattern isgenerated in an external device such as a refrigerator, a clock, or ahumidifier, the apparatus 100 may determine a noise pattern by analyzingthe noise signal.

According to an exemplary embodiment, the apparatus 100 may receive thenoise information from the outside. For example, the apparatus 100 mayreceive from an external device cycle information of a noise signal thatis generated in the external device. In this case, the external devicemay obtain the cycle information of the noise signal by analyzing thenoise signal through a microphone that is included in the externaldevice.

The apparatus 100 may determine a noise pattern of the noise signal thatis input through the audio input device by using the cycle informationof the noise signal that is received from the external device.

In operation S1540, the apparatus 100 may remove noise by using an audiooutput device.

According to an exemplary embodiment, the apparatus 100 may reduce thenoise signal by using an active noise cancellation or active noisecontrol (ANC) technology. ANC reduces ambient noise by generating afirst noise whose phase is opposite to that of a second noise that isinput through a microphone and combining the first noise with the secondnoise.

According to an exemplary embodiment, the apparatus 100 may generate ananti-phase noise pattern having a phase that is opposite to that of theambient noise pattern that is determined in operation S1530. Theapparatus 100 may continuously output the anti-phase noise patternthrough the audio output device (e.g., a speaker). In this case, thenoise signal around the object 10 may be reduced due to the anti-phasenoise pattern.

According to an exemplary embodiment, the apparatus 100 may synchronizea first cycle in which a noise pattern is repeated in the noise signalwith a second cycle in which the anti-phase noise pattern is output.When the first cycle and the second cycle are not synchronized with eachother, since noise may not be reduced and may be amplified, theapparatus 100 may increase a reduction in the noise signal bysynchronizing the first cycle with the second cycle.

According to an exemplary embodiment, the apparatus 100 may output ananti-phase noise pattern through a plurality of audio output devices.

According to an exemplary embodiment, the apparatus 100 may remove onlynoise that is generated in a specific device (e.g., a device designatedby the object 10). For example, the apparatus 100 may select a firstnoise pattern that is related to the specific device from among aplurality of noise patterns by using cycle information of a noise signalthat is received from the specific device. The apparatus 100 may outputa first anti-phase noise pattern having a phase that is opposite to thatof the selected first noise pattern through the audio output device(e.g., a speaker).

For example, when the object 10 is insensitive to a sound of arefrigerator and is sensitive to a sound of an hour hand of a clock, theapparatus 100 may not reduce a noise signal that is generated by therefrigerator and may reduce only a noise signal that is generated by theshort hand of the clock by using periodic characteristics of a noisepattern of the short hand of the clock.

According to an exemplary embodiment, the audio input device and theaudio output device may be embedded in one device or may be disposed asseparate devices. Also, according to an exemplary embodiment, theapparatus 100 may reduce noise by using the audio input device and theaudio output device that are located in the apparatus 100, and mayreduce noise by using the audio input device and the audio output devicethat are included in the external device. For example, the apparatus 100may reduce the noise signal around the object 10 by using a smartphoneor a TV including the audio/output devices.

An operation performed by the apparatus 100 to remove noise around theobject 10 who is sleeping will now be explained in more detail withreference to FIGS. 16 through 19.

FIG. 16 is a graph illustrating a triggered spectral subtraction methodusing periodic characteristics of a noise pattern, according to anexemplary embodiment.

In operation S1610, the apparatus 100 may determine a noise pattern 1600of a noise signal 1610 by calculating a cycle value of the noise signal1610 that is input through a microphone or receiving cycle informationfrom a device that generates noise.

In operation S1620, the apparatus 100 may cancel the noise signal 1610by outputting an anti-phase noise pattern having a phase that isopposite to that of the noise pattern 1600. In this case, the apparatus100 may synchronize a cycle in which the noise pattern 1600 repeats witha cycle in which the anti-phase noise pattern is output, and maycontinuously output the anti-phase noise pattern.

FIGS. 17 and 18 are views illustrating an example where the apparatus100 removes noise around the object 10 by using an audio output device,according to an exemplary embodiment.

Referring to FIG. 17, the apparatus 100 may recognize that the object 10is sleeping based on information that is received through the sensor105. In this case, when a value of a noise signal that is generated inan external device 1720 is greater than or equal to a critical value,the noise signal may disturb the object 10 who is sleeping. Accordingly,the apparatus 100 may analyze the noise signal that is generated in theexternal device 1720 and is input through an audio input device 1711.

The apparatus 100 may use a microphone that is included in a device 1710such as a smartphone, a tablet PC, or a TV as the audio input device1711. In this case, the smartphone, the tablet PC, or the TV may beconnected in a wired or wireless manner to the apparatus 100.

The external device 1720 may be located around the object 10 who issleeping and may generate periodic noise. Examples of the externaldevice 1720 may include, but are not limited to, a clock, arefrigerator, a humidifier, an air conditioner, a washing machine, and acomputer.

When it is found, as a result of the analysis of the noise signal, thata value of the noise signal that is generated in the external device1720 is greater than or equal to a critical value, the apparatus 100 mayreduce the noise signal that is generated in the external device 1720based on an ANC technology in order to improve the sleep quality of theobject 10.

Referring to FIG. 18, the apparatus 100 may determine a noise pattern ofthe noise signal that is generated in the external device 1720 and mayoutput an anti-phase noise pattern through an audio output device 1712.The apparatus 100 may use a speaker that is included in the device 1710such as a smartphone, a tablet PC, or a TV as the audio output device1712.

According to an exemplary embodiment, noise around the object 10 may bereduced due to the anti-phase noise pattern that is output through theaudio output device 1712. Accordingly, the sleep quality of the object10 may be improved.

FIG. 19 is a view illustrating an example where the apparatus 100 uses aplurality of audio output devices, according to an exemplary embodiment.

Referring to FIG. 19, the apparatus 100 may output an anti-phase noisepattern through a plurality of audio output devices. For example, theapparatus 100 may output an anti-phase noise pattern through the audiooutput device 1712 that is located around the object 10 who is sleepingand, at the same time, may further output an anti-phase noise patternthrough a second audio output device 1900 that is located around theexternal device 1720. In this case, a reduction in a noise signal thatis generated in the external device 1720 may be increased.

Although not shown in FIG. 19, an anti-phase noise pattern may not beoutput from the audio output device 1712 that is located around theobject 10, and an anti-phase noise pattern may be output only from thesecond audio output device 1900 that is located around the externaldevice 1720. Further, anti-phase noise patterns may be output throughthree or more audio output devices.

A method of reducing power consumption of the audio output device 1712that reduces a noise signal will now be explained.

FIG. 20 is a flowchart illustrating a method of removing noise accordingto a sleep depth of the object 10, according to an exemplary embodiment.

In operation S2010, the apparatus 100 may inactivate an audio outputdevice in order to reduce stand-by power consumption. For example, whenthe object 10 is not in a room or a sound is not reproduced through theaudio output device, the apparatus 100 may maintain the audio outputdevice in an inactive state.

In operation S2020, the apparatus 100 may recognize that the object 10is sleeping and may measure a sleep depth of the object 10.

According to an exemplary embodiment, the apparatus 100 may analyze amovement during sleep of the object 10 and may measure the sleep depthbased on a result of the analysis. For example, the apparatus 100 mayreceive movement information of the object 10 through a motion sensorthat is located in a pillow or a mattress or on a wrist of the object10. In this case, when a movement value of the object 10 that isdetected by the motion sensor is greater than or equal to a firstcritical value, the apparatus 100 may determine that a sleep depth levelof the object 10 is at a first level. Also, when the movement value ofthe object 10 is between the first critical value and a second criticalvalue, the apparatus 100 may determine the sleep depth level of theobject 10 is at a second level, and when the movement value of theobject 10 is less than the second critical value, the apparatus 100 maydetermine that the sleep depth level of the object 10 is at third level.

According to an exemplary embodiment, the apparatus 100 may measure thesleep depth by using EEG information that is obtained through an EEGsensor. For example, the apparatus 100 may determine whether the object10 is in a rapid eye movement (REM) sleep state or a non-rapid eyemovement (NREM) sleep state by using the EEG information. Also, when theobject 10 is in the REM sleep state, the apparatus 100 may determinethat the sleep depth of the object 10 is low and when the object 10 isin the NREM sleep state, the apparatus 100 may determine that the sleepdepth of the object 10 is high.

In operation S2030, the apparatus 100 may determine whether the sleepdepth of the object 10 is less than a critical value. Also, theapparatus 100 may classify levels of the sleep depth of the object 10according to a preset standard.

According to an exemplary embodiment, if it is determined in operationS2030 that the sleep depth of the object 10 is greater than the criticalvalue, the method returns to operation S2010 in which the apparatus 100may maintain the audio output device in the inactive state in order toreduce power consumption. For example, when the object 10 sleeps deeply,since a sound sleep of the object 10 is not greatly affected by noisearound the object 10, the apparatus 100 may maintain the audio outputdevice in the inactive state and may not output an anti-phase noisesignal.

If it is determined in operation S2030 that the sleep depth of theobject 10 is less than the critical value, the method proceeds tooperation S2040. In operation S2040, the apparatus 100 may activate theaudio output device and may reduce noise by using the activated audiooutput device.

According to an exemplary embodiment, the apparatus 100 may reduce anoise signal by using an ANC technology.

Operation S2030 corresponds to operation S1540 of FIG. 15.

In operation S2040, the apparatus 100 may determine whether the object10 wakes up. When the object 10 does not wake up, the method returns tooperation S2020 in which the apparatus 100 may measure again the sleepdepth of the object 10. When the sleep depth is measured to be greaterthan the critical value, the apparatus 100 may inactivate the activatedaudio output device. Also, when the sleep depth of the object 10 is lessthan the critical value, the apparatus 100 may maintain the audio outputdevice in an active state and may continuously remove noise.

An operation performed by the apparatus 100 to control noise accordingto a sleep depth of the object 10 will be further explained withreference to FIG. 21.

FIG. 21 is a graph illustrating an example where the apparatus 100determines whether to activate an audio output device according to asleep depth or cycle of the object 10, according to an exemplaryembodiment.

The apparatus 100 may measure a sleep depth of the object 10, and maydetermine whether to activate the audio output device and whether tooutput an anti-phase noise pattern according to the measured sleepdepth. For example, when the sleep state of the object 10 is a deepsleep state, the apparatus 100 may inactivate the audio output deviceand my not output the anti-phase noise pattern, and when the sleep stateof the object 10 is a shallow sleep state, the apparatus 100 mayactivate the audio output device and may output the anti-phase noisepattern.

As shown in FIG. 21, since the audio output device is inactivated andthe anti-phase noise signal is not output in a NREM sleep interval inwhich the object 10 is in a deep sleep state, noise around the object 10may not be reduced. In contrast, since the audio output device isactivated and the anti-phase noise signal is output through the audiooutput device in a REM sleep interval, noise around the object 10 may bereduced.

According to an exemplary embodiment, an output intensity of theanti-phase noise pattern may be adjusted according to the sleep depth ofthe object 10. For example, when the object 10 is in a deep sleep state,since the object 10 is not greatly affected by noise, the apparatus 100may reduce the output intensity of the anti-phase noise pattern and mayreduce a noise reduction. Also, when the object 10 is in a shallow sleepstate, since the object 10, who is sleeping, is disturbed by noise, theapparatus 100 may increase the output intensity of the anti-phase noisepattern and may increase the noise reduction. For example, when theobject 10 is in a deep sleep state, the apparatus 100 may adjust thenoise reduction to be about 50%, and, when the object 10 is in a shallowsleep state, the apparatus 100 may adjust the noise reduction to beabout 99%. As the noise reduction increases, it may be more quite aroundthe object 10.

An example where an alarm condition is adjusted according to a sleepdepth of the object 10 will now be explained with reference to FIG. 22.

FIG. 22 is a flowchart illustrating a method of adjusting an alarmcondition according to a sleep depth of the object 10, according to anexemplary embodiment.

In operation S2210, the apparatus 100 may detect an alarm event.

The alarm event may refer to an event in which information that has tobe notified to the object 10 is generated. The alarm event may be anevent for notifying a situation that occurs inside the apparatus 100 oran event for notifying a situation that occurs outside the apparatus100. Examples of the alarm event may include, but are not limited to, ascheduled alarm event, a wake-up alarm event, a charge request alarmevent, a message reception alarm event, an update alarm event, arecommended content alarm event, a health information alarm event, anemergency alarm event, a traffic information alarm event, and anadvertising alarm event.

For example, when the apparatus 100 receives an alarm message from anexternal device using near-field communication, the apparatus 100 maydetect that an event for outputting the alarm message occurs.

In operation S2220, when the alarm event occurs, the apparatus 100 maydetermine whether the object 10 is sleeping.

According to an exemplary embodiment, the apparatus 100 may determinewhether the object 10 is sleeping by using, for example, at least one ofan iris recognition sensor, an image sensor, a microphone, anacceleration sensor, and a tilt sensor. For example, the apparatus 100may determine that the object 10 is sleeping when a state where amovement value of the object 10 that is measured by a motion sensor(e.g., an acceleration sensor, a tilt sensor, or a geomagnetic sensor)is less than or equal to a critical value is maintained for apredetermined period of time.

When a value of a pressure sensor that is embedded in a pillow or amattress is greater than or equal to a critical value and a respirationpattern of the object 10 is a respiration pattern during sleep, theapparatus 100 may determine that the object 10 is sleeping. Also, theapparatus 100 may analyze a sound signal that is obtained through amicrophone, and when a sound of a snoring pattern is detected, maydetermine that the object 10 is sleeping.

When the number of times eyes of the object 10 blink, which is measuredthrough an iris recognition sensor attached to an eye patch, is lessthan a critical number of times (e.g., one eye blinking is detected for10 minutes) or an iris is not detected for a predetermined period oftime (e.g., 5 minutes), the apparatus 100 may determine that the object10 is sleeping.

According to an exemplary embodiment, the apparatus 100 may capture animage of an eye of the object 10 in predetermined cycles by using animage sensor (e.g., the camera 232), and may detect a pupil byperforming edge analysis on the captured image of the eye. In this case,when the pupil is not detected in the captured image of the eye for apredetermined period of time (e.g., 5 minutes or longer), the apparatus100 may determine that the object 10 is sleeping.

According to an exemplary embodiment, when it is not determined inoperation S2220 that the object 10 is sleeping, the method proceeds tooperation S2250. In operation S2250, the apparatus 100 may output analarm signal related to the alarm event by using a predetermined alarmcondition. For example, when a message is received from the externaldevice, the apparatus 100 may output an alarm sound indicating that themessage is received and may directly display the received message on adisplay.

If it is determined in operation S2220 that the object 10 is sleeping,the method proceeds to operation S2230. In operation S2230, theapparatus 100 may measure a sleep depth of the object 10.

According to an exemplary embodiment, the apparatus 100 may analyze amovement of the object 10 during sleep and may measure the sleep depthbased on a result of the analysis. For example, the apparatus 100 mayreceive movement information of the object 10 through a motion sensorthat is located in the pillow or the mattress or on a wrist of theobject 10. In this case, when a movement value of the object 10 that isdetected by the motion sensor is greater than or equal to a firstcritical value, the apparatus 100 may determine that a sleep depth levelof the object 10 is at a first level. Also, when the movement value ofthe object 10 is between the first critical value and a second criticalvalue, the apparatus 100 may determine that the sleep depth level of theobject 10 is at a second level, and when the movement value of theobject 10 is less than the second critical value, the apparatus 100 maydetermine that the sleep depth level of the object 10 is at a thirdlevel.

According to an exemplary embodiment, the apparatus 100 may measure thesleep depth by using EEG information that is obtained through an EEGsensor. For example, the apparatus 100 may determine whether the object10 is in a REM sleep state or a NREM sleep state by using the EEGinformation. Also, when the object 10 is in the REM sleep state, theapparatus 100 may determine that the sleep depth of the object 10 is lowand when the object 10 is in the NREM sleep state, the apparatus 100 maydetermine that the sleep depth of the object 10 is high.

In operation S2240, the apparatus 100 may determine an alarm conditioncorresponding to the sleep depth of the object 10. In operation S2250,the apparatus 100 may output an alarm signal related to the alarm eventby using the determined alarm condition.

According to an exemplary embodiment, the apparatus 100 may adjust anoutput intensity of the alarm signal according to the sleep depth of theobject 10. For example, as the sleep depth of the object 10 decreases,the object 10 easily responds to an external environment. Accordingly,the apparatus 100 may reduce the output intensity of the alarm signal ifit is determined that the sleep depth of the object 10 is low. Incontrast, as the sleep depth increases, the object 10 does not easilyrespond to the external environment. Accordingly, the apparatus 100 mayincrease the output intensity of the alarm signal if it is determinedthat the sleep depth of the object 10 is high.

FIG. 23 is a view illustrating an example where an intensity of an alarmsignal is adjusted according to a sleep depth of the object 10,according to an exemplary embodiment.

Referring to FIG. 23, when the object 10 is in a shallow sleep state,the apparatus 100 may determine the intensity of the alarm signal to bea first level, when the object 10 is in a transitional sleep statebetween the shallow sleep state and a deep sleep state, the apparatus100 may determine the intensity of the alarm signal to be a secondlevel, and when the object 10 is in the deep sleep state, the apparatus100 may determine the intensity of the alarm signal to be a third level.

Accordingly, when the object 10 deeply sleeps, the apparatus 100 mayincrease the intensity of the alarm signal so that the object 10 mayrapidly respond to the alarm signal.

Although an intensity of an alarm signal increases as a sleep depthincreases in FIG. 23, the apparatus 100 may reduce the intensity of thealarm signal as the sleep depth increases.

Referring back to FIG. 22, the apparatus 100 may adjust an output cycleof the alarm signal according to the sleep depth of the object 10. Forexample, as the sleep depth of the object 10 increases, the apparatus100 may increase the output cycle of the alarm signal in order to notwake up the object 10. Alternatively, as the sleep depth of the object10 increases, the apparatus 100 may reduce the output cycle of the alarmsignal in order to wake up the object 10.

The apparatus 100 may determine the alarm condition corresponding to thesleep depth of the object 10 by taking into account an urgency of thealarm event. For example, when the urgency of the alarm event is high,the apparatus 100 may reduce the output cycle of the alarm signal as thesleep depth of the object 10 increases, in order to wake up the object10. Also, when the urgency of the alarm event is low, the apparatus 100may increase the output cycle of the alarm signal as the sleep depth ofthe object 10 increases, in order not to wake up the object 10.

FIGS. 24 and 25 are views illustrating an example where an alarm signalcycle is adjusted according to a sleep depth of the object 10 and anurgency of an alarm event, according to an exemplary embodiment.

Referring to FIG. 24, the apparatus 100 may receive from a humidifier2400 a signal indicating that the humidifier 2400 needs to be filledwith water. In this case, the apparatus 100 may detect that an alarmevent for outputting a message indicating that the humidifier 2400 needsto be filled with water occurs.

The apparatus 100 may determine an urgency of the alarm event. Forexample, the apparatus 100 may determine whether the alarm eventcorresponds to an urgent alarm event that is stored in the storage 108.Also, the apparatus 100 may analyze content that is included in amessage that is received from the outside and may determine the urgencyof the alarm event.

When the event for outputting the message indicating that the humidifier2400 needs to be filled with water is not designated as the urgent alarmevent, the apparatus 100 may determine that the urgency of the alarmevent is low.

Since the urgency of the alarm event for outputting the messageindicating that the humidifier 2400 needs to be filled with water islow, when the object 10 is deeply sleeping (e.g., in a NREM sleepstate), the apparatus 100 may increase an output cycle of the alarmsignal in order not to wake up the object 10. In contrast, when theobject 10 is shallowly sleeping (e.g., in a REM sleep state), theapparatus 100 may reduce the output cycle of the alarm signal so thatthe object 10 fills the humidifier 2400 with water. The apparatus 100may control the portable terminal 210 of the object 10 to output amessage indicating that the humidifier 2400 needs to be filled withwater according to the determined output cycle.

Referring to FIG. 25, the apparatus 100 may receive a disaster warningsignal (e.g., an earthquake, flood, or fire warning signal) from anexternal server. In this case, the apparatus 100 may detect that analarm event 2500 for outputting a disaster warning message and adisaster warning sound occurs.

The apparatus 100 may determine an urgency of the alarm event 2500. Forexample, since the alarm event 2500 corresponds to an urgent alarm eventthat is stored in the storage 108, the apparatus 100 may determine thatthe urgency of the alarm event 2500 is high. Also, the apparatus 100 mayanalyze a message (e.g., a weather alert message) that is included inthe disaster warning signal received from the external server and maydetermine that the urgency of the alarm event 2500 is high.

Since the urgency of the alarm event 2500 is high, when the object 10 isdeeply sleeping (e.g., in a NREM sleep state), the apparatus 100 mayreduce an output cycle of an alarm signal in order to wake up the object10. For example, the apparatus 100 may control the portable terminal 210to output the disaster warning message and the disaster warning sound at1-minute intervals when the object 10 is shallowly sleeping (e.g., in aREM sleep state), and may control the portable terminal 210 to outputthe disaster warning message and the disaster warning sound at 10-secondintervals when the object 10 is deeply sleeping (e.g., in the NREM sleepstate).

According to an exemplary embodiment, the apparatus 100 may determine anoutput time of the alarm signal according to a sleep depth of the object10. For example, the apparatus 100 may control the portable terminal 210not to output the alarm signal when the sleep depth of the object 10 ishigh (e.g., the NREM sleep state) and to output the alarm signal whenthe sleep depth of the object 10 is low (e.g., the REM sleep state).

According to an exemplary embodiment, the apparatus 100 may determine anoutput type of the alarm signal according to the sleep depth of theobject 10. The output type of the alarm signal may be at least one of avibration signal, an audio signal, and a video signal.

For example, when the sleep depth of the object 10 is high (e.g., theNREM sleep state), the apparatus 100 may output the alarm signal as avideo signal, and when the sleep depth of the object 10 is low (e.g.,the REM sleep state), the apparatus 100 may output the alarm signal asan audio signal. Also, when the urgency of the alarm event is high andthe sleep depth of the object 10 is high, the apparatus 100 may outputthe alarm signal as all of a vibration signal, an audio signal, and avideo signal.

An example where, when the object 10 is sleeping, the apparatus 100 mayautomatically notify an external device that the object 10 is sleepingwill now be explained.

FIG. 26 is a flowchart illustrating a method of transmitting to theoutside a message indicating that the object 10 is sleeping, accordingto an exemplary embodiment.

In operation S2610, the apparatus 100 may detect that the portableterminal 210 of the object 10 receives a call or a message from anexternal device. According to an exemplary embodiment, the portableterminal 210 of the object 10 may be connected in a wired or wirelessmanner to the apparatus 100. According to another exemplary embodiment,the apparatus 100 may be included in the portable terminal 210.

In operation S2620, the apparatus 100 may obtain state information ofthe object 10. For example, the apparatus 100 may collect informationsensed by the sensor 105 or an external IoT device, and may analyze astate of the object 10 based on the collected information. Also, theapparatus 100 may receive from the external IoT device information aboutthe state of the object 10 that is analyzed by the external IoT device.Operation S2620 corresponds to operation S1510 of FIG. 15.

In operation S2630, the apparatus 100 may determine whether the object10 is sleeping based on the state information of the object 10.

Operation S2630 corresponds to operation S1520 of FIG. 15.

If it is determined in operation S2630 that the object 10 is sleeping,the method proceeds to operation S2640. In operation S2640, theapparatus 100 may transmit a message indicating that the object 10 issleeping to the external device. For example, when the object 10 is in adeep sleep state, the apparatus 100 may automatically transmit aresponse message indicating that the object 10 is sleeping to theexternal device. Also, when a predetermined period of time (e.g., 1minute) elapses after the call or the message is received, the apparatus100 may transmit the message indicating that the object 10 is sleepingto the external device.

In this case, the external device may be a device that is designated bythe object 10. For example, in order to prevent private life informationof the object 10 from being unrestrictedly exposed, only when theexternal device that transmits the call or the message is a designateddevice (e.g., a device of a family member or a significant other), theapparatus 100 may transmit the message indicating that the object 10 issleeping to the external device.

FIG. 27 is a view illustrating an example where the apparatus 100transmits a message indicating that a first object is sleeping to adevice of a second object, according to an exemplary embodiment.

Referring to FIG. 27, in operation S2701, a first device 2711 of a firstobject 2710 who is sleeping may receive a text message from a seconddevice 2721 of a second object 2720. The first device 2711 may notifythe apparatus 100 that the text message is received.

In operation S2702, since the apparatus 100 is monitoring a state of thefirst object 2710, the apparatus 100 may recognize that the first object2710 is sleeping when the text message is received. The apparatus 100may determine whether the second device 2721 of the second object 2720is a terminal that is designated to share state information of the firstobject 2710. If it is determined that the second device 2721 is aterminal that is designated to share the state information of the firstobject 2710, the apparatus 100 may control the first device 2711 totransmit the state information of the first object 2710 to the seconddevice 2721 of the second object 2720 (S2703).

For example, in operation S2703, the first device 2711 of the firstobject 2710 may transmit an alarm message (e.g., “Tom is sleeping”)indicating that the first object 2710 is sleeping to the second device2721.

According to an exemplary embodiment, when the first object 2710 is in ashallow sleep state, the apparatus 100 may control the first device 2711not to output a text message reception alarm sound and to transmit amessage indicating that the first object 2710 is sleeping.

According to an exemplary embodiment, the second object 2720 mayrecognize that the first object 2710 is sleeping by checking the alarmmessage (e.g., “Tom is sleeping”) received from the first device 2711 inresponse to the text message. Accordingly, the second object 2720 doesnot have to unnecessarily wait for a response message of the firstobject 2710.

FIG. 28 is a view illustrating an example where the apparatus 100outputs a preset message through an intercom device 2800, according toan exemplary embodiment.

In operation S2801, the apparatus 100 may receive a visit signal fromthe intercom device 2800. For example, a second object 2820 may come toa house of a first object 2810 and may push a doorbell of the intercomdevice 2800 that is attached to a front door of the house of the firstobject 2810. In this case, the intercom device 2800 may transmit to theapparatus 100 a visit signal indicating that a stranger, the secondobject 2820, visits.

In operation S2802, since the apparatus 100 is monitoring a state of thefirst object 2810, the apparatus 100 may recognize that the first object2810 is sleeping when the visit signal is received.

In operation S2803, since the first object 2810 is sleeping and thus maynot respond to the visit of the second object 2820, the apparatus 100may output a preset message through the intercom device 2800. Forexample, the apparatus 100 may control the intercom device 2800 tooutput the preset message saying ‘Please come back later’ as a voice ortext. In this case, the second object 2820 does not have to wait for along time in front of the house of the first object 2810 by pushing thedoorbell several times.

When a home delivery service is expected at 3 PM, the first object 2810may go to sleep after setting the apparatus 100 that when a visit signalis received, a message saying ‘Please leave it at the security office’is output. When the second object 2820 (e.g., a courier) pushes thedoorbell that is included in the intercom device 2800 at 3 PM, theapparatus 100 may control the intercom device 2800 to output the messagesaying ‘Please leave it at the security office’.

A method performed by the apparatus 100 to change a wake-up alarm methodwhen the object 10 wakes up and then went back to sleep according to anexemplary embodiment will now be explained.

FIG. 29 is a flowchart illustrating a method performed by the apparatus100 to transmit going-back-to-sleep information of a first object to adevice of a second object, according to an exemplary embodiment.

In operation S2910, the apparatus 100 may output a wake-up alarm signal.

According to an exemplary embodiment, the apparatus 100 may output thewake-up alarm signal at a target wake-up time that is adjusted accordingto a sleep state of the first object. For example, when the number oftimes a posture of the first object is changed is greater than or equalto a critical number of times (e.g., 30 times), the apparatus 100 maychange the target wake-up time from 7 AM to 7:10 AM and may output thewake-up alarm signal at 7:10 AM Also, when the number of times theposture of the first object is changed is greater than or equal to thecritical number of times (e.g., 30 times), an apnea cycle of the firstobject is twice or more longer than an average apnea cycle, and a bodytemperature is higher than or equal to 38° C., the apparatus 100 maychange the target wake-up time from 7 AM to 7:30 AM and may output thewake-up alarm signal at 7:30 AM

In operation S2920, the apparatus 100 may determine whether the firstobject wakes up.

According to an exemplary embodiment, the apparatus 100 may capture animage of an eye of the first object in predetermined cycles by using animage sensor (e.g., the camera 232), and may detect a pupil byperforming edge analysis on the captured image of the eye. In this case,when the pupil is detected a predetermined number of times or more inthe image of the eye, the apparatus 100 may determine that the firstobject wakes up.

If it is determined in operation S2920 that the first object does notwake up after the wake-up alarm signal is output, the method proceeds tooperation S2930. In operation S2930, the apparatus 100 may re-output thewake-up alarm signal. For example, the apparatus 100 may re-output asound at 1-minute intervals to wake up the first object.

In operation S2940, the apparatus 100 may detect that the first objectwho wakes up went back to sleep. According to an exemplary embodiment,when it is detected that the first object sleeps within a preset time(e.g., 15 minutes) after the wake-up alarm signal is output, theapparatus 100 may determine that the first object went back to sleep.

For example, when it is detected that the first object wakes upaccording to the wake-up alarm signal at 7:30 AM, and then it isdetected that the first object is sleeping at 7:40 AM, the apparatus 100may determine that the first object went back to sleep.

A method performed by the apparatus 100 to determine whether the object10 sleeps has been explained above.

In operation S2950, the apparatus 100 may transmit going-back-to-sleepinformation of the first object to the device of the second object. Thesecond object may be a person that is designated by the first object.For example, the second object may be at least one of family members ofthe first object or a roommate of the first object. Also, thegoing-back-to-sleep information may be information indicating that thefirst object wakes up and then went back to sleep.

According to an exemplary embodiment, the second object may be aplurality of people. In this case, the apparatus 100 may transmit thegoing-back-to-sleep information of the first object to a plurality ofdevices. For example, the apparatus 100 may transmit informationindicating that the first object is going back to sleep to a mobilephone of a friend of the first object and a mobile phone of a mother ofthe first object.

According to an exemplary embodiment, when the first object went back tosleep by mistake, the apparatus 100 may enable the second object to wakeup the first object by transmitting the going-back-to-sleep informationof the first object to the device of the second object.

FIG. 30 is a view illustrating an example where the apparatus 100transmits going-back-to-sleep information of a first object 3010 to adevice of a second object 3020, according to an exemplary embodiment.

Referring to 3001 of FIG. 30, since it is 5 AM, the first object 3010may be sleeping. The apparatus 100 may analyze a sleep pattern of thefirst object 3010 and may adjust a target wake-up time according to thesleep pattern of the first object 3010. For example, the apparatus 100may determine the target wake-up time of the first object 3010 to be 7AM

Referring to 3002 of FIG. 30, the apparatus 100 may output a wake-upalarm signal at 7 AM that is the target wake-up time. For example, theapparatus 100 may output a specific sound through an alarm clock.

The first object 3010 may wake up in response to the wake-up alarmsignal. In this case, the apparatus 100 may detect that the first object3010 wakes up by using a motion sensor or a pressure sensor.

Referring to 3003 of FIG. 30, the first object 3010 may wake up, mayinactivate an alarm function of the alarm clock, and then may go back tosleep. In this case, the apparatus 100 may detect that the first object3010 went back to sleep, and may transmit going-back-to-sleepinformation of the first object 3010 to a mobile phone 3021 of thesecond object 3020 who exists around the first object 3010. For example,the apparatus 100 may transmit a message saying ‘Tom went back tosleep!!’ to the mobile phone 3021 of the second object 3020 who is amother of the first object 3010.

The second object 3020 may check the message (e.g., ‘Tom went back tosleep!!’ displayed on the mobile phone 3021, may go to a bedroom of thefirst object 3010, and may wake up the first object 3010.

FIG. 31 is a flowchart illustrating a method performed by the apparatus100 to output a wake-up alarm signal by sequentially using a pluralityof devices, according to an exemplary embodiment.

In operation S3110, the apparatus 100 may output a wake-up alarm signalthrough a first device. For example, the apparatus 100 may output thewake-up alarm signal through one of an alarm clock, the portableterminal 210, the wearable terminal 220, and the display device 230 ofthe object 10.

According to an exemplary embodiment, the apparatus 100 may output thewake-up alarm signal at a target wake-up time that is adjusted accordingto a sleep state of the object 10.

In operation S3120, the apparatus 100 may determine whether the object10 wakes up. The apparatus 100 may determine whether the object 10 wakesup by using one or more of the previously described methods.

If it is determined in operation S3120 that the object 10 does not wakeup after the wake-up alarm signal is output, the method proceeds tooperation S3130. In operation S3130, the apparatus 100 may re-output thewake-up alarm signal through the first device. For example, theapparatus 100 may re-output a sound at 1-minute intervals through thefirst device to wake up the object 10.

In operation S3140, the apparatus 100 may detect that the object 10 whowakes up went back to sleep. According to an exemplary embodiment, whenit is detected that the object 10 seeps within a preset time (e.g., 30minutes) after the wake-up alarm signal is output, the apparatus 100 maydetermine that the object 10 went back to sleep.

Methods performed by the apparatus 100 to determine whether the object10 sleeps have been described above.

In operation S3150, if it is determined that the object 10 went back tosleep, the apparatus 100 may output the wake-up alarm signal through asecond device that is different from the first device. For example, theapparatus 100 may transmit to the second device a control command tooutput the wake-up alarm signal.

An example where the apparatus 100 further outputs a wake-up alarmsignal through a second device that is different from a first devicewill now be explained with reference to FIG. 32.

FIG. 32 is a view illustrating an example where the apparatus 100outputs a wake-up alarm signal through a display device 3002 as well asan alarm clock 3001 when the object 10 went back to sleep, according toan exemplary embodiment.

Referring to 3210 of FIG. 32, since it is 5 AM, the object 10 may besleeping. The apparatus 100 may analyze a sleep pattern of the object 10and may adjust a target wake-up time according to the sleep pattern ofthe object 10. For example, the apparatus 100 may determine the targetwake-up time of the object 10 to be 7 AM

Referring to 3220 of FIG. 32, the apparatus 100 may output a wake-upalarm signal at 7 AM that is the target wake-up time. For example, theapparatus 100 may output a first wake-up alarm signal (e.g., an alarmsound) through the alarm clock 3001. The object 10 may wake up inresponse to the first wake-up alarm signal. In this case, the apparatus100 may detect that the object 10 wakes up by using a motion sensor or apressure sensor.

Referring to 3230 of FIG. 32, the object 10 may wake up, may inactivatean alarm function of the alarm clock 3001, and may go back to sleep. Theapparatus 100 may detect that the object 10 went back to sleep and mayoutput a second wake-up alarm signal through the display device 3002.For example, the display device 3002 may output a wake-up alarm soundand a wake-up alarm message (e.g., Good morning, Tom!!!).

According to an exemplary embodiment, when the object 10 wakes up andthen went back to sleep by mistake, the apparatus 100 may effectivelywake up the object 10 by outputting the second wake-up alarm signalthrough a second device that is different from a first device thatoutputs the first wake-up alarm signal.

When the object 10 went back to sleep after the second wake-up alarmsignal is output, the apparatus 100 may output a third wake-up alarmsignal through a third device. As non-limiting examples, the apparatus100 may output a vibration signal through a smart watch that is worn onthe object 10.

FIG. 33 is a timing diagram illustrating a method of displaying scheduleinformation through a display device when the object 10 wakes up,according to an exemplary embodiment.

In operation S3310, the apparatus 100 may monitor a sleep state of theobject 10. Exemplary methods performed by the apparatus 100 to monitor asleep state of the object 10 have been described above.

In operation S3320, the apparatus 100 may determine whether the object10 wakes up. Exemplary methods performed by the apparatus 100 todetermine whether the object 10 wakes up have been described above.

If it is determined in operation S3320 that the object 10 wakes up, themethod proceeds to operation S3330. In operation S3330, the apparatus100 may determine whether there is a schedule related to the object 10.For example, the apparatus 100 may determine whether there is a scheduleregistered in a personal cloud server of the object 10 or the portableterminal 210 of the object 10.

If it is determined in operation S3330 that there is a schedule relatedto the object 10, the method proceeds to operation S3340. In operationS3340, the apparatus 100 may transmit schedule information to thedisplay device 230. When the apparatus 100 is included in the displaydevice 230, operation S3340 may be omitted.

In operation S3350, the display device 100 may display the scheduleinformation. For example, the display device 100 may display informationabout a schedule that is to be performed within a predetermined periodof time after the object 10 wakes up or a first event scheduled afterthe object 10 wakes up (e.g., buying a train ticket).

According to an exemplary embodiment, the object 10 may rapidly checkthe schedule information through the display device 230 after waking up.In particular, when there is a special event, the object 10 may bereminded of the special event after waking up. For example, when anauction of a specific product on a social commerce site starts at 6 AM,the object 10 may set a wake-up alarm to 5:55 AM and may go to sleep.When the object 10 wakes up at 5:55 AM, the object 10 may check amessage (e.g., an auction of a specific product starts at 6 AM) that isoutput through the display device 230.

FIG. 34 is a view illustrating an example where, when the object 10wakes up, schedule information is displayed on the display device 230,according to an exemplary embodiment.

Referring to 3400-1 of FIG. 34, the object 10 may set a wake-up alarm to7 AM that is 2 hours earlier than 9 AM, which is an average wake-uptime, in order to buy a discount airline ticket that is offered by anairline as a special event, and then may go to sleep. In this case, atarget wake-up time of the object 10 may be 7 AM

Referring to 3400-2 of FIG. 34, the apparatus 100 may output a wake-upalarm signal at 7 AM that is the target wake-up time. For example, theapparatus 100 may output a wake-up alarm sound through an alarm clock.

The object 10 may wake up in response to the wake-up alarm signal. Inthis case, since the object 10 wakes up 2 hours earlier than 9 AM, theobject 10 may forget to buy the airline ticket and go back to sleep.Accordingly, in order to prevent the object 10 from forgetting a specialevent, the apparatus 100 may control the display device 230 to displaythe schedule information within a predetermined time (e.g., 1 hour)after the wake-up alarm signal is output. For example, when sales ofdiscount airline tickets start at 7:05 AM, the apparatus 100 may outputa voice message or a text message, ‘It is 5 minutes before the sale ofairline tickets starts. Please access an airline site,’ through thedisplay device 230.

An example where power consumption of a peripheral device is reducedwhile the object 10 is sleeping will now be explained.

FIG. 35 is a timing diagram illustrating a method of changing anoperation mode of a peripheral device to a power saving mode when theobject 10 is sleeping, according to an exemplary embodiment.

In operation S3510, the apparatus 100 may obtain state information ofthe object 10. Operation S3510 corresponds to operation S1510 of FIG.15.

In operation S3520, the apparatus 100 may determine whether the object10 is sleeping based on the state information of the object 10.Operation S3520 corresponds to operation S1520 of FIG. 15.

If it is determined in operation S3520 that the object 10 is sleeping,the method proceeds to operation S3530. In operation S3530, theapparatus 100 may transmit to the IoT hub 200 a mode change request forchanging an operation mode of a peripheral device to a power savingmode.

According to an exemplary embodiment, the apparatus 100 may select someperipheral devices that may change to the power saving mode from among aplurality of peripheral devices that are connected to the IoT hub 200.For example, the apparatus 100 may classify a refrigerator, an aircleaner, and a humidifier as devices that need to continuously operate,and may classify a washing machine, a microwave oven, a TV, a computer,and a Wi-Fi access point (AP) as devices that may change to the powersaving mode.

In operation S3540, the IoT hub 200 may change the operation mode of theperipheral device to the power saving mode, in response to the modechange request.

For example, the IoT hub 200 may transmit a control signal forcommanding to set the power saving mode to a peripheral device that isconnected to the IoT hub 200. Also, the IoT hub 200 may transmit to apower supply controller a request to cut off power supply to somedevices (e.g., a TV, a microwave oven, an oven, and a coffee machine).In this case, the power supply controller may cut off power supply tothe some devices, thereby reducing power consumption.

According to an exemplary embodiment, the IoT hub 200, instead of theapparatus 100, may select some peripheral devices that may change to thepower saving mode, from among a plurality of peripheral devices. In thiscase, the IoT hub 200 may transmit a control command to change theselected some peripheral devices to the power saving mode and mayreceive mode change completion messages from the selected peripheraldevices.

FIG. 36 is a view illustrating an example where, when a plurality ofobjects are sleeping, an operation mode of a peripheral device ischanged to a power saving mode, according to an exemplary embodiment.FIG. 36 will be explained on the assumption that a first object 3610 anda second object 3620 sleep in one bed.

Referring to FIG. 36, the first object 3610 may go to sleep at 11 PM andthe second object 3620 may go to sleep at 12 AM. The apparatus 100 maydetect that the first object 3610 and the second object 3620 go to sleepby monitoring states of the first object 3610 and the second object 3620through the sensors 105 and 105′.

The apparatus 100 may transmit a mode change request to the IoT hub 200based on a sleep time of the second object 3620 who goes to sleep laterthan the first object 3610. For example, the apparatus 100 may transmitthe mode change request to the IoT hub 200 at 12 AM, the time at whichthe second object 3620 goes to sleep. In this case, the IoT hub 200 maytransmit a command to set a power saving mode to a washing machine 3601,a refrigerator 3602, a microwave oven 3603, a computer 3605, a smart TV3606, and an audio output device 3607 that are connected to the IoT hub200.

According to an exemplary embodiment, the apparatus 100 may transmit themode change request to the IoT hub 200 at 11 PM at which the firstobject 3610 goes to sleep for a device that is not used by the secondobject 3620 and is used by only the first object 3610. For example, theapparatus 100 may transmit the mode change request to a laptop computerof the first object 3610 that is used only by the first object 3610 at11 PM.

FIG. 37 is a timing diagram illustrating a method of cancelling a powersaving mode of a peripheral device (or requesting an operation of apredetermined device) when the object 10 wakes up, according to anexemplary embodiment.

In operation S3710, the apparatus 100 may monitor a sleep state of theobject 10.

For example, the apparatus 100 may obtain sleep state information of theobject 10 who is sleeping.

Operation S3710 corresponds to operation S3310 of FIG. 33.

In operation S3720, the apparatus 100 may output a wake-up alarm signal.

According to an exemplary embodiment, the apparatus 100 may output thewake-up alarm signal at a target wake-up time that is adjusted accordingto the sleep state of the object 10.

In operation S3730, the apparatus 100 may determine whether the object10 wakes up.

According to an exemplary embodiment, if it is determined in operationS3730 that the object 10 does not wake up, the method returns tooperation S3710 in which the apparatus 100 may continuously monitor thesleep state of the object 10.

If it is determined in operation S3730 that the object 10 wakes up, themethod proceeds to operation S3740. In operation S3740, the apparatus100 may transmit to the IoT hub 200 an operation request to cancel apower saving mode and to operate a predetermined device. For example,the apparatus 100 may transmit to the IoT hub 200 a request to changethe operation modes of IoT devices, which were changed to power savingmodes when the object 10 went to sleep, to active modes. Also, theapparatus 100 may transmit a request to operate specific devices to theIoT hub 200 based on routine behavior pattern information after theobject 10 wakes up. For example, the apparatus 100 may transmit to theIoT hub 200 a request to start up a car or to turn on a boiler.

In operation S3750, the IoT hub 200 may control a peripheral device inresponse to the request to cancel the power saving mode or to operatethe specific device. An operation performed by the IoT hub 200 tocontrol the peripheral device will now be explained in detail withreference to FIG. 38.

FIG. 38 is a view illustrating an example where, when the object 10wakes up, a predetermined device automatically operates, according to anexemplary embodiment.

Referring to 3800-1 of FIG. 38, since it is 5 AM, the object 10 may besleeping. The apparatus 100 may analyze a sleep pattern of the object 10and may adjust a target wake-up time according to the sleep pattern ofthe object 10. For example, the apparatus 100 may determine the targetwake-up time of the object 10 to be 7 AM

Also, in order to reduce power consumption while the object 10 issleeping, the apparatus 100 may request the IoT hub 200 cut off powersupply to a coffee machine 3802, a Wi-Fi AP 3803, a cleaner 3804, or anoven 3805 or to change an operation mode to a power saving mode.Accordingly, a Wi-Fi communication function of a mobile phone 3800 ofthe object 10 may be inactivated while the object 10 is sleeping.

Referring to 3800-2 of FIG. 38, the apparatus 100 may output a wake-upalarm signal at 7 AM that is the target wake-up time. For example, theapparatus 100 may output a wake-up alarm sound through an alarm clock.

The object 10 may wake up in response to the wake-up alarm signal. Theapparatus 100 may detect that the object 10 wakes up. In this case, theapparatus 100 may control peripheral devices through the IoT hub 200 tocause the peripheral devices, which were changed to power saving modeswhile the object 10 was sleeping, to cancel the power saving modes. Forexample, the Wi-Fi AP 3803 may normally operate. Accordingly, when theobject 10 wakes up, the Wi-Fi communication function of the mobile phone3800 of the object 10 may be automatically activated.

Also, the apparatus 100 may predict a behavior after the object 10 wakesup based on routine behavior pattern information of the object 10, andmay operate some devices in advance. For example, the apparatus 100 maycontrol a shower 3801 to fill water for a half-body bath, may controlthe coffee machine 3802 to brew coffee, may control the cleaner 3804 tostart a cleaning operation, or may control the oven 3805 to start apreheating operation through the IoT hub 200.

According to an exemplary embodiment, when a plurality of objects(people) live together, the apparatus 100 may transmit a power savingmode cancel request to the IoT hub 200 based on a wake-up time of afirst object who wakes up the earliest from among the plurality ofobjects.

Also, when only a second object from among the plurality of objectsdrinks coffee in the morning, the apparatus 100 may control the coffeemachine 3802 to brew coffee at a wake-up time of the second object. Inthis case, information about devices that are commonly used by theplurality of objects and devices that are individually used may bestored in the apparatus 100.

The apparatus 100 according to an exemplary embodiment may monitor asleep state of the object 10 and may adaptively provide an alarmaccording to the sleep state of the object 10. Also, the apparatus 100may improve the sleep quality of the object 10 by controlling peripheraldevices according to the sleep state of the object 10.

The above-described exemplary embodiments may be implemented as anexecutable program, and may be executed by a general-purpose digitalcomputer that runs the program by using a computer-readable recordingmedium. Also, a structure of data used in the method may be recorded byusing various units on a non-transitory computer-readable medium.Non-limiting examples of the computer-readable medium include storagemedia such as magnetic storage media (e.g., read only memories (ROMs),floppy discs, or hard discs) and optically readable media (e.g., compactdisk-read only memories (CD-ROMs), or digital versatile disks (DVDs)).

While certain exemplary embodiments have been shown and described, itwill be understood by those of ordinary skill in the art that variouschanges in form and details may be made therein without departing fromthe spirit and scope of the inventive concept as defined by the appendedclaims and their equivalents. The described one or more exemplaryembodiments should be considered in descriptive sense only and not forpurposes of limitation. Therefore, the scope of the inventive concept isdefined not by the detailed description, but by the appended claims andtheir equivalents, and all differences within the scope should beconstrued as being included in the inventive concept.

What is claimed is:
 1. A method performed by an apparatus configured toimprove a sleep of an object who is sleeping, the method comprising:determining a wake-up time of the object as a first value based onschedule information corresponding to a schedule of the object;receiving bio-information of the object; measuring a sleep statevariable of the object from the bio-information, wherein the sleep statevariable comprises at least one from among a number of posture changesand respiration information; determining whether the sleep statevariable exceeds a predetermined critical value, changing the wake-uptime from the first value to a second value that is later than the firstvalue when the sleep state variable exceeds the predetermined criticalvalue; and outputting a wake-up alarm signal at the changed wake-uptime.
 2. The method of claim 1, wherein the schedule information of theobject comprises at least one of average wake-up time information,wake-up time information before going to sleep, bedtime information,schedule information before going to sleep, blood alcohol levelinformation before going to sleep, and schedule information after wakingup.
 3. The method of claim 1, wherein the sleep state variable furthercomprises at least one from among heart rate information, apnea cycleinformation, movement information, snoring pattern information, eyeballmovement information, and body temperature information of the object. 4.The method of claim 1, further comprising: measuring an actual wake-uptime of the object; determining a remaining time from the actual wake-uptime of the object to a preset critical time; selecting at least oneactivity that is to be performed by the object during the remainingtime; and providing information about the selected at least one activityto the object.
 5. The method of claim 1, further comprising: detectingthat the object wakes up; and providing information about an event thatoccurs within a preset time after the object wakes up.
 6. An apparatusconfigured to improve a sleep of an object who is sleeping, theapparatus comprising: a communicator; a controller configured to:control the communicator to receive bio-information of the object thatis measured by a sensor; determine a wake-up time of the object as afirst value based on schedule information corresponding to a schedule ofthe object; measure a sleep state variable of the object from thebio-information, wherein the sleep state variable comprises at least onefrom among a number of posture changes and respiration information;determine whether the sleep state variable exceeds a predeterminedcritical value; and change the wake-up time from the first value to asecond value that is later than the first value when the sleep statevariable exceeds the predetermined critical value; and an output deviceconfigured to output a wake-up alarm signal at the changed wake-up time.7. The apparatus of claim 6, wherein the communicator is furtherconfigured to receive infrared image information of the object from anexternal display device, and the controller is further configured toobtain heart rate information of the object based on the receivedinfrared image information, and monitor the heart rate information. 8.The apparatus of claim 6, wherein the controller is further configuredto obtain at least one of respiration rate information, respirationcycle information, and respiration volume information of the object byusing depth value information that is obtained using a depth camera. 9.The apparatus of claim 6, wherein the controller is further configuredto: detect that the object is sleeping within a preset time after thechanged wake-up time, and control the communicator to transmitinformation indicating that the object is sleeping to a device of adesignated third party.
 10. The apparatus of claim 6, wherein the outputdevice comprises a first device and a second device, the second devicebeing different from the first device, and the controller is furtherconfigured to output a first wake-up alarm signal through the firstdevice at the second value, and, in response to it being detected thatthe object is sleeping within a preset time after the second value,output a second wake-up alarm signal through the second device.
 11. Analarm method of an apparatus configured to improve sleep of an objectwho is sleeping, the alarm method comprising: detecting an alarm event;measuring a sleep depth of the object and determining whether the sleepdepth is a low sleep depth, or a high sleep depth; determining an alarmcondition corresponding to the sleep depth; and outputting an alarmsignal related to the alarm event based on the determined alarmcondition, wherein an output cycle of the alarm signal is a first cyclewhen the sleep depth is a low sleep depth, and the output cycle of thealarm signal is a second cycle, shorter than the first cycle, when thesleep depth is a high sleep depth.
 12. The alarm method of claim 11,wherein the detecting the alarm event comprises receiving an alarmmessage from an external device using near-field communication.
 13. Thealarm method of claim 11, wherein the determining the alarm conditioncomprises determining the alarm condition corresponding to the sleepdepth based on an urgency of the alarm event.
 14. An apparatusconfigured to improve sleep of an object, the apparatus comprising: acommunicator; a controller configured to: control the communicator toreceive information about an alarm event and bio-information of theobject that is measured by a sensor, measure a sleep depth of the objectbased on the bio-information, determine whether the sleep depth is a lowsleep depth, or a high sleep depth, and determine an alarm conditioncorresponding to the sleep depth; and an output device configured tooutput an alarm signal related to the alarm event based on thedetermined alarm condition, wherein the output device controls an outputcycle of the alarm signal to be a first cycle when the sleep depth is alow sleep depth, and wherein the output device controls the output cycleof the alarm signal to be a second cycle, shorter than the first cycle,when the sleep depth is a high sleep depth.
 15. The apparatus of claim14, wherein the controller is further configured to determine the alarmcondition corresponding to the sleep depth based on an urgency of thealarm event.
 16. The apparatus of claim 14, wherein the controller isfurther configured to determine an output time of the alarm signal basedon the sleep depth, and control the output device to output the alarmsignal at the determined output time.
 17. An apparatus configured tocontrol ambient noise, the apparatus comprising: a communicator; anaudio input device; a controller configured to: control the communicatorto receive bio-information of an object that is measured from a sensor;control the audio input device to detect a noise signal, determinewhether a sleep state of the object is a deep sleep state or a lightsleep state, based on the bio-information, and determine a noise patternhaving periodic characteristics by analyzing the noise signal; and anaudio output device configured to output an anti-phase noise patternhaving a phase that is opposite to a phase of the noise pattern, whereinan output intensity of the anti-phase noise pattern is a first levelwhen the object is in the deep sleep state, and the output intensity ofthe anti-phase noise pattern is a second level, higher than the firstlevel, when the object is in the light sleep state.
 18. The apparatus ofclaim 17, wherein the audio input device is further configured to detectthe noise signal within a predetermined distance from the object.
 19. Anon-transitory computer-readable recording medium having embodiedthereon a program for executing the method of claim
 1. 20. Anon-transitory computer-readable recording medium having embodiedthereon a program for executing the method of claim 11.